Three-dimensional model display method and device, equipment and storage medium

Abstract

The embodiment of the invention discloses a three-dimensional model display method and device, equipment and a storage medium, and the method comprises the steps: playing a teaching courseware through a teaching application, the teaching courseware comprises data related to a three-dimensional model, and the three-dimensional model corresponding to the data presents a plane display effect when the teaching courseware is played; the teaching application sends a notification of displaying the three-dimensional model to a three-dimensional display application; the three-dimensional display application obtains a three-dimensional model corresponding to the data from the teaching application based on the notification; the three-dimensional display application displays the three-dimensional model in a virtual three-dimensional environment, and the three-dimensional model presents a three-dimensional display effect in the three-dimensional display application so as to realize virtual reality interaction. By adopting the method, the technical problem that the display effect of the model in the three-dimensional space cannot be achieved when the three-dimensional teaching model in the teaching courseware is displayed in the two-dimensional space in the related technology can be solved.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of virtual reality technology, and in particular to a three-dimensional model display method, device, equipment and storage medium. Background Art

[0002] Teaching courseware is a way that is conducive to teaching, and its purpose is to help students better integrate into the classroom atmosphere. At present, in some teaching scenarios (such as solid geometry teaching scenarios, etc.), adding three-dimensional teaching models to teaching courseware is a relatively common technical means. However, when playing teaching courseware, the three-dimensional teaching model can only achieve a three-dimensional display effect on a two-dimensional plane through the depth experienced based on illusion, that is, the three-dimensional teaching model in the teaching courseware is a three-dimensional teaching model displayed in a two-dimensional space on a plane. This is different from the actual display effect of the teaching model in the three-dimensional space, that is, the display of the teaching model in the three-dimensional space cannot be presented. At this time, the user can only view the teaching model in the two-dimensional space, which is not conducive to the user's learning of the real teaching model in the three-dimensional space, which greatly reduces the teaching effect. Summary of the invention

[0003] The embodiments of the present application provide a three-dimensional model display method, device, equipment and storage medium to solve the technical problem in the related art that the three-dimensional teaching model in the teaching courseware cannot achieve the display effect of the model in the three-dimensional space when it is displayed in the two-dimensional space.

[0004] In a first aspect, an embodiment of the present application provides a three-dimensional model display method, the method comprising:

[0005] Playing teaching courseware using a teaching application, wherein the teaching courseware includes data related to a three-dimensional model, and the three-dimensional model corresponding to the data presents a plane display effect when the teaching courseware is played;

[0006] The teaching application sends a notification to display the three-dimensional model to the three-dimensional display application;

[0007] The three-dimensional display application obtains the three-dimensional model corresponding to the data from the teaching application based on the notification;

[0008] The three-dimensional display application displays the three-dimensional model in a virtual three-dimensional environment, and the three-dimensional model presents a three-dimensional display effect in the three-dimensional display application to realize virtual reality interaction.

[0009] In a second aspect, an embodiment of the present application further provides a three-dimensional model display device, the device comprising:

[0010] A playback unit, used to play teaching courseware using a teaching application, wherein the teaching courseware includes data related to a three-dimensional model, and the three-dimensional model corresponding to the data presents a plane display effect when the teaching courseware is played;

[0011] A sending unit, configured to send a notification for displaying the three-dimensional model from the teaching application to the three-dimensional display application;

[0012] A first acquisition unit, configured to enable the three-dimensional display application to acquire a three-dimensional model corresponding to the data from the teaching application based on the notification;

[0013] The display unit is used to enable the three-dimensional display application to display the three-dimensional model in a virtual three-dimensional environment, and the three-dimensional model presents a three-dimensional display effect in the three-dimensional display application to realize virtual reality interaction.

[0014] In a third aspect, an embodiment of the present application further provides a three-dimensional model display device, the device comprising:

[0015] one or more processors;

[0016] A memory for storing one or more programs;

[0017] When the one or more programs are executed by the one or more processors, the one or more processors implement the three-dimensional model display method as described in the first aspect.

[0018] In a fourth aspect, an embodiment of the present application further provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the three-dimensional model display method as described in the first aspect.

[0019] In one embodiment of the present application, when a teaching courseware containing data related to a three-dimensional model is played using a teaching application, the three-dimensional model presents a plane display effect, that is, the three-dimensional model is displayed in a two-dimensional space. After that, the teaching application notifies the three-dimensional display application to display the three-dimensional model. The three-dimensional display application obtains the three-dimensional model from the teaching application according to the notification of the teaching application and displays the three-dimensional model in a virtual three-dimensional environment. At this time, the three-dimensional model presents a three-dimensional display effect, and the three-dimensional model under the three-dimensional display effect can be used for virtual reality interaction. Through the aforementioned technical means, the technical problem that the three-dimensional teaching model in the teaching courseware in the related technology cannot achieve the display effect of the model in the three-dimensional space when it is displayed in the two-dimensional space can be solved. By using a three-dimensional display application with a virtual reality function and a teaching application to cooperate, when it is necessary to explain the three-dimensional model displayed in the teaching application, the three-dimensional display application can be used to display the three-dimensional model in the virtual three-dimensional environment, that is, to achieve a VR display effect, so that the user can immersively watch the three-dimensional model in the virtual three-dimensional environment, and then control the three-dimensional model in the virtual three-dimensional environment through VR interaction, so that the capabilities of the three-dimensional model are fully displayed, which is more conducive to the explanation and learning of the three-dimensional model, and ensures the teaching effect. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] Figure 1 A flowchart of a three-dimensional model display method provided for one embodiment of the present application;

[0021] Figure 2 This is a schematic diagram of a communication link between a teaching application and a three-dimensional display application in one embodiment of the present application;

[0022] Figure 3 A flowchart of another three-dimensional model display method provided by one embodiment of the present application;

[0023] Figure 4 A schematic diagram of a teaching courseware playback interface provided by an embodiment of the present application;

[0024] Figure 5 A schematic diagram of displaying a three-dimensional model in a virtual three-dimensional environment provided by an embodiment of the present application;

[0025] Figure 6 A flowchart of another three-dimensional model display method provided for an embodiment of the present application;

[0026] Figure 7 An example diagram of a data transmission path related to a three-dimensional model provided in one embodiment of the present application;

[0027] Figure 8 A schematic diagram of a teaching courseware production interface provided by an embodiment of the present application;

[0028] Fig. 9A schematic diagram of the structure of a three-dimensional model display device provided in one embodiment of the present application;

[0029] Fig.10 A schematic structural diagram of a three-dimensional model display device provided in accordance with an embodiment of the present application. DETAILED DESCRIPTION

[0030] The present application will be further described in detail below in conjunction with the accompanying drawings and embodiments. It is to be understood that the specific embodiments described herein are used to explain the present application, rather than to limit the present application. It should also be noted that, for ease of description, only parts related to the present application, rather than all structures, are shown in the accompanying drawings.

[0031] The three-dimensional model display method provided in the embodiment of the present application can be implemented by a three-dimensional model display device. The three-dimensional model display device can be composed of one physical entity or two or more physical entities.

[0032] In one embodiment, when the 3D model display device is composed of a physical entity, the physical entity is a device that is installed with an operating system and can realize virtual reality, that is, a VR device installed with an operating system. For example, the 3D model display device can be a VR all-in-one machine or a desktop VR interactive all-in-one machine.

[0033] Among them, Virtual Reality is a brand-new practical technology developed in the 20th century. Based on VR technology, a virtual world with realistic three-dimensional vision, touch, smell and other sensory experiences can be created, so that people in the virtual world can feel as if they are in the real world.

[0034] VR all-in-one is a VR head display with an independent processor based on VR technology. It uses head-mounted display devices to block people's vision and hearing from the outside world, guiding users to feel like they are in a virtual environment. VR all-in-one has independent computing, input and output functions.

[0035] The desktop VR interactive all-in-one machine is a desktop-level display device based on VR technology. When used with 3D glasses, it can enable users to view a three-dimensional virtual environment (i.e., the virtual world).

[0036] When using a 3D model display device, the virtual environment can be controlled through interactive devices such as a handle or an interactive pen (also called a touch pen), such as switching the current viewing angle in the virtual environment, and moving, scaling, rotating, splitting or combining objects in the virtual environment. The interactive device and the 3D model display device can establish a connection via Bluetooth, infrared or WIFI. After the connection, the interactive device can control the objects in the virtual environment generated by the 3D model display device to achieve VR interaction.

[0037] Exemplarily, the 3D model display device may be installed with at least one operating system, wherein the specific type of the operating system is not currently limited, for example, the operating system may be a Windows system or an Android system, etc. Currently, the operating system is taken as an example of a Windows system.

[0038] Under the operating system, the 3D model display device can install at least one application (also referred to as application software, software program, etc.), and the installed application can be an application that comes with the operating system, or an application downloaded from a third-party device or server. By running the installed application, the 3D model display device can realize the functions corresponding to the application.

[0039] Currently, the three-dimensional model display device is installed with at least an application for realizing VR display and an application for playing teaching courseware.

[0040] Exemplarily, the application used to implement VR display is recorded as a three-dimensional display application, through which users can be placed in a virtual environment (i.e., three-dimensional space). Currently, the three-dimensional display application is used to display the three-dimensional model added to the teaching courseware in a virtual environment to achieve a three-dimensional display effect. Optionally, the three-dimensional display application is an application developed based on the Unity engine. Unity is a real-time 3D (i.e., three-dimensional) interactive content creation and operation platform. The Unity platform provides a complete set of software solutions that can be used to create, operate and realize any real-time interactive two-dimensional and three-dimensional content. In actual applications, the three-dimensional display application can also be an application developed based on other engines, which is not limited in the embodiments.

[0041] Exemplarily, the application used to play teaching courseware is recorded as a teaching application, and the teaching courseware used in teaching can be played through the teaching application. Optionally, the teaching application is an application developed based on the Electron framework. Electron is a cross-platform desktop application framework built using JavaScript, HTML and CSS. Electron is compatible with Windows systems and can build applications that run in Windows systems. In actual applications, the teaching application can also be an application developed based on other frameworks, and the embodiments do not limit this.

[0042] In one embodiment, when the three-dimensional model display device is composed of multiple physical entities, the multiple physical entities include at least a VR device and an electronic device. Among them, the VR device can be the aforementioned VR all-in-one machine or desktop VR interactive all-in-one machine, and can also be an external head-mounted display device, etc. The VR device is installed with the aforementioned three-dimensional display application. The electronic device can be a mobile phone, an interactive smart tablet, a laptop computer, a desktop computer, a tablet computer, etc. At present, the electronic device is an electronic device where the PC end (i.e., the personal computer end) is located. The electronic device is installed with an operating system (such as a Windows system), and the aforementioned teaching application is installed under the operating system.

[0043] Currently, whether the 3D model display device is one physical entity or multiple physical entities, it is based on the mutual cooperation between the teaching application and the 3D display application, so that when the teaching application plays the teaching courseware, the 3D model in the teaching courseware is imported into the 3D display application, so that the 3D display application displays the 3D model in the virtual environment, thereby realizing the user's VR interaction with the 3D model.

[0044] In one embodiment, Figure 1 A flowchart of a three-dimensional model display method provided by an embodiment of the present application. Figure 1 When the three-dimensional model display device executes the three-dimensional model display method, the three-dimensional model display method includes steps 110 to 140:

[0045] Step 110: Use the teaching application to play the teaching courseware, which contains data related to the three-dimensional model. The three-dimensional model corresponding to the data presents a planar display effect when the teaching courseware is played.

[0046] Exemplarily, the teaching courseware may be a courseware produced based on Microsoft Office, or a courseware produced based on a word processing system (Word Processing System, WPS). Among them, teaching courseware in the format of doc or docx can be produced based on Word in Microsoft Office and WPS Word in WPS. Teaching courseware in the format of ppt or pptx can be produced based on PowerPoint (PPT) in Microsoft Office and WPS Presentation in WPS. In actual applications, other applications can also be used to produce teaching courseware.

[0047] In one embodiment, the teaching courseware includes data related to the three-dimensional model. The three-dimensional model may also be referred to as a 3D model or a stereoscopic model, which may be generated by a three-dimensional modeling tool or by other methods. The three-dimensional model may include multiple sub-models, that is, these sub-models may be obtained by disassembling the three-dimensional model, and similarly, the three-dimensional model may be obtained by synthesizing these sub-models. The sub-model may be considered as the smallest object constituting the three-dimensional model. For the same three-dimensional model, the sub-models included in the three-dimensional model may be different at different degrees of disassembly. For example, the three-dimensional model is a human body model. At one degree of disassembly, the sub-model may include the head, neck, drive and limbs of the human body. At another more refined degree of disassembly, the sub-model may be a more detailed division. Taking the left hand of the human body as an example, the more detailed sub-model includes the palm and five fingers. Optionally, when constructing a three-dimensional model, the sub-model of the three-dimensional model may be obtained.

[0048] Currently, the number of three-dimensional models in the teaching courseware is one or more, and there is no current limit.

[0049] The data related to the three-dimensional model can be understood as data used to obtain the three-dimensional model, that is, through the data related to the three-dimensional model, it is possible to clarify what kind of three-dimensional model it is. Each three-dimensional model has corresponding data related to the three-dimensional model. In one embodiment, the data related to the three-dimensional model includes a two-dimensional image of the three-dimensional model and a model attachment associated with the two-dimensional image, or the data related to the three-dimensional model includes a model entity of the three-dimensional model.

[0050] Among them, the two-dimensional picture of the three-dimensional model can be understood as a picture containing the three-dimensional model, and the content contained in the picture (i.e., the three-dimensional model) cannot be edited. For example, a picture obtained by photographing or screenshotting the three-dimensional model can be considered as a two-dimensional picture of the three-dimensional model. The two-dimensional picture is associated with a model attachment. The model attachment can be understood as an attached file used to describe the model. Currently, the three-dimensional model file obtained when creating the three-dimensional model can be used as a model attachment. The three-dimensional model file is used to store the information of the three-dimensional model, which can be stored in text or in binary.

[0051] In one embodiment, a two-dimensional image of a three-dimensional model is associated with a model attachment, so that in the subsequent application process, the associated model attachment can be obtained based on the two-dimensional image. Among them, the method of realizing the association is not currently limited. For example, a hyperlink of the model attachment is added to the two-dimensional image to realize the association between the two-dimensional image and the model attachment. For example, the two-dimensional image and the model attachment using the same association code have an associated relationship. Among them, the association code can be composed of letters, symbols and / or numbers. The association code is unique. The creation rules of the association code are not currently limited, and only uniqueness needs to be satisfied. In one embodiment, the MD5 value of the two-dimensional image is used as the association code. At this time, the two-dimensional image and the corresponding model attachment are associated through the MD5 value of the two-dimensional image.

[0052] The MD5 message digest algorithm is a widely used cryptographic hash function that can generate a 128-bit hash value to ensure complete and consistent information transmission. After the two-dimensional image is generated, the MD5 message digest algorithm can be used on the two-dimensional image to obtain the MD5 value of the two-dimensional image. Then, the MD5 value is used to associate the two-dimensional image with the model attachment. That is, when obtaining the two-dimensional image, the MD5 value of the two-dimensional image can be obtained at the same time. Then, the model attachment using the MD5 value is searched, and the model attachment is the model attachment associated with the two-dimensional image.

[0053] The model entity of the 3D model can be understood as a 3D model rendered based on a 3D model file. That is, by drawing according to the information stored in the 3D model file, the 3D model described by it can be obtained.

[0054] Optionally, when the application for making teaching courseware has the function of inserting a three-dimensional model, the model entity of the three-dimensional model can be directly inserted into the teaching courseware. In this case, the data related to the three-dimensional model in the teaching courseware refers to the model entity of the three-dimensional model. That is, the application for making teaching courseware can render the corresponding three-dimensional model in the teaching courseware based on the three-dimensional model file. At this time, the three-dimensional model only presents a plane display effect in the teaching courseware. Among them, the plane display effect can be understood as the depth experienced due to illusion on a two-dimensional plane, that is, the display effect obtained after the three-dimensional model is rendered in a two-dimensional space. Under the plane display effect, although the user can view the three-dimensional model, the three-dimensional model is also a model displayed on a two-dimensional plane, and the user cannot interact with the three-dimensional model in VR. When inserting a three-dimensional model in a teaching courseware, the application for making teaching courseware and the teaching application can only perform simple rotation operations on the three-dimensional model in the teaching courseware, and other control operations cannot be implemented.

[0055] Optionally, when the application for making teaching courseware does not have the function of inserting a three-dimensional model, the two-dimensional image of the three-dimensional model and the associated model attachments can be inserted into the teaching courseware. In this case, the data related to the three-dimensional model refers to the two-dimensional image of the three-dimensional model and the model attachments associated with the two-dimensional image. When the application for making teaching courseware inserts the two-dimensional image and the associated model attachments into the teaching courseware together, the two-dimensional image is displayed in the teaching courseware, and the model attachments are hidden in the teaching courseware. At this time, the effect of displaying the three-dimensional model in the teaching courseware can be achieved by displaying the two-dimensional image in the teaching courseware. In addition, since the three-dimensional model in the two-dimensional image presents a plane display effect, the three-dimensional model displayed by the two-dimensional image in the teaching courseware is also a plane display effect. The application for making teaching courseware and the teaching application cannot operate the three-dimensional model in the two-dimensional image, that is, the user cannot interact with the three-dimensional model in VR, and can only adjust the plane display effect of the three-dimensional model by adjusting (such as zooming) the two-dimensional image.

[0056] It is understandable that when the application for making teaching courseware has the function of inserting a 3D model, the 2D picture of the 3D model and the associated model attachments can also be inserted into the teaching courseware. In this case, the data related to the 3D model in the teaching courseware can include the 2D picture of the 3D model and the associated model attachments and / or the model entity of the 3D model, and a 3D model has only one kind of related data.

[0057] For example, after the teaching courseware is produced, it can be obtained by the teaching application to open and play the teaching courseware in the teaching application. Optionally, when the teaching courseware is in different formats, the teaching application used to open the teaching courseware can also be different. For example, the teaching application used to open the teaching courseware in doc format and the teaching application used to open the teaching courseware in ppt format can be different teaching applications.

[0058] After the teaching application opens the teaching courseware, it plays the teaching courseware. For example, when the teaching courseware is in doc or docx format, after the teaching application opens the teaching courseware, it can be considered as playing the teaching courseware. When the teaching courseware is in ppt or pptx format, after the teaching application opens the teaching courseware, after selecting the option to implement "show", the teaching courseware can be played.

[0059] Optionally, when playing teaching courseware, the teaching application cannot edit the content of the teaching courseware.

[0060] Optionally, when playing the teaching courseware, the three-dimensional model displayed in the teaching courseware is a plane display effect. It is understandable that based on the different types of data related to the three-dimensional model, the three-dimensional model can be displayed in two ways in the teaching courseware, one is to display the model entity of the three-dimensional model, and the other is to display the two-dimensional picture of the three-dimensional model. When the teaching courseware displays the model entity, the three-dimensional model contained in the teaching courseware mentioned in the embodiment refers to the three-dimensional model corresponding to the model entity. When the teaching courseware displays a two-dimensional picture, the three-dimensional model contained in the teaching courseware mentioned in the embodiment refers to the three-dimensional model displayed by the two-dimensional picture.

[0061] Step 120: The teaching application sends a notification to display the 3D model to the 3D display application.

[0062] Currently, the notification of displaying the three-dimensional model can be understood as a notification that the three-dimensional model needs to be displayed in a virtual reality manner.

[0063] In one embodiment, a notification for displaying a three-dimensional model is generated by a teaching application. Optionally, when the teaching application plays the teaching courseware, if it is determined that the teaching courseware contains a three-dimensional model, a notification for displaying the three-dimensional model may be generated. Optionally, when the teaching application plays the teaching courseware, if a three-dimensional model display instruction is received, a notification for displaying the three-dimensional model may be generated. Among them, the three-dimensional model display instruction refers to an instruction manually issued and instructing to use virtual reality to display the three-dimensional model. Optionally, when the teaching application plays the teaching courseware, if a three-dimensional model display instruction is received, the three-dimensional model contained in the teaching courseware is parsed, and then a notification for displaying the three-dimensional model is generated. Among them, the process of parsing the three-dimensional model contained in the teaching courseware can be understood as the process of obtaining the corresponding three-dimensional model file. For example, the corresponding three-dimensional model file is obtained based on the model entity of the three-dimensional model. For another example, the file contained in the model attachment associated with the two-dimensional picture is used as a three-dimensional model file. Each three-dimensional model can be parsed into a corresponding three-dimensional model file.

[0064] After the teaching application generates a notification to display the three-dimensional model, it sends the notification to the three-dimensional display application. The teaching application and the three-dimensional display application can communicate based on a network. In one embodiment, the teaching application uses the Hyper Text Transfer Protocol (HTTP) to send a notification to the three-dimensional display application. At this time, this step can be specifically as follows: the teaching application sends a notification to display the three-dimensional model to the three-dimensional display application via the Hyper Text Transfer Protocol. Exemplarily, the three-dimensional display application has an HTTP service (i.e., HTTP server), and a notification to display the three-dimensional model can be received through the HTTP service. Afterwards, the HTTP service sends the received notification to the three-dimensional display application, and the three-dimensional display application determines to use virtual reality to display the three-dimensional model based on the notification, and then executes step 130.

[0065] Step 130: The three-dimensional display application obtains the three-dimensional model corresponding to the data from the teaching application based on the notification.

[0066] Exemplarily, after the 3D display application receives the notification sent by the teaching application and determines to display the 3D model in a virtual reality manner according to the notification, the 3D display application can obtain the 3D model to be displayed from the teaching application. Optionally, when the teaching courseware currently played by the teaching application contains multiple 3D models, the 3D display application can obtain multiple 3D models at the same time, or the 3D display application only obtains the 3D model in the teaching courseware currently displayed in the interface of the teaching application.

[0067] Optionally, when the 3D display application obtains the 3D model, it may obtain a 3D model file, and then render the 3D model based on the 3D model file. Currently, the 3D model rendered by the 3D display application can be understood as a model entity.

[0068] Optionally, the 3D display application uses the network to download the 3D model from the teaching application. When downloading, the File Transfer Protocol (FTP) can be used. At this time, this step can be specifically as follows: the 3D display application obtains the 3D model corresponding to the data from the teaching application through the File Transfer Protocol based on the notification. Among them, FTP is a set of standard protocols for transferring files on the network. The 3D display application can transfer files with the teaching application through the network based on FTP. For example, the current 3D display application downloads the 3D model file from the teaching application based on FTP, and then obtains the solid model based on the 3D model file.

[0069] At this time, the communication link between the teaching application and the 3D display application is as follows: Figure 2 Reference Figure 2 The 3D display application includes an HTTP server and a display interaction module, and the display interaction module is used to display the 3D model and realize VR interaction. When the teaching courseware is played in the teaching application, the teaching application can send a notification of displaying the 3D model to the HTTP server of the 3D display application through HTTP. Correspondingly, the display interaction module of the 3D display application downloads the 3D model from the teaching application through FTP based on the notification.

[0070] Step 140: The three-dimensional display application displays the three-dimensional model in the virtual three-dimensional environment, and the three-dimensional model presents a three-dimensional display effect in the three-dimensional display application to realize virtual reality interaction.

[0071] Exemplarily, after the three-dimensional display application obtains the three-dimensional model, it can display the three-dimensional model in a virtual three-dimensional environment, that is, render the three-dimensional model in a three-dimensional space, so that the user can have the viewing effect of viewing the three-dimensional model in a three-dimensional space. The display effect of the three-dimensional model in the virtual three-dimensional environment can be considered as a three-dimensional display effect. The three-dimensional display effect can refer to the display effect of the current existing VR device for VR display, which is not described separately at present. It can be understood that the virtual three-dimensional environment currently mentioned can be understood as a virtual environment, which is a virtual world created by the three-dimensional display application, and the virtual world is a three-dimensional space. It can be understood that when it is necessary to cooperate with VR glasses to achieve a three-dimensional display effect, the user wears VR glasses to view the three-dimensional model presented in the virtual three-dimensional environment through the VR glasses. At this time, the VR glasses can also be included in the three-dimensional model display device.

[0072] Optionally, after displaying the three-dimensional model in the virtual three-dimensional environment, the user can perform virtual reality interaction (i.e., VR interaction) on the three-dimensional model in the virtual three-dimensional environment. Currently, virtual reality interaction can be understood as rotating, disassembling, synthesizing, scaling and other control operations on the three-dimensional model in the virtual three-dimensional environment, so that the user can understand the actual structure of the three-dimensional model more intuitively and three-dimensionally.

[0073] Optionally, in order to realize virtual reality interaction, the 3D display application also constructs a collision body of the 3D model before displaying the 3D model, so that when displaying the 3D model, the 3D model with the collision body can be displayed. Among them, the collision body (BoxCollider) can also be understood as a collision box or a collision body box, which is a basic cubic collision unit. Under the Unity engine, the collision body can be detected by rays. That is, under the Unity engine, the Unity ray (Ray) can be understood as a ray used to detect the collision body. Among them, the Unity ray can be emitted by a device (such as a handle, an interactive pen) that interacts with the 3D display application. At this time, after the interactive device detects the collision body through the ray, the object contained in the collision body can be controlled (such as scaling, rotating, splitting or combining, etc.). When the 3D display application creates the collision body of the 3D model, it can create the collision body of the entire 3D model, or it can create the collision body of each sub-model in the 3D model. Optionally, the user can select the disassembly degree of the 3D model in the 3D display application. The greater the disassembly degree, the more detailed the disassembly of the 3D model. Currently, at the most detailed disassembly degree, each sub-model in the 3D model has a corresponding collision body. At other disassembly levels, different sub-models can be combined into partial 3D models, and each partial 3D model has a corresponding collision body. After the collision body is created, the 3D display application can display the 3D model and the created collision body for users to interact with virtual reality.

[0074] In the above embodiment, a teaching application is used to play a teaching courseware containing data related to a three-dimensional model. At this time, the three-dimensional model presents a plane display effect, that is, the three-dimensional model is displayed in a two-dimensional space. After that, the teaching application notifies the three-dimensional display application to display the three-dimensional model. The three-dimensional display application obtains the three-dimensional model from the teaching application according to the notification of the teaching application and displays the three-dimensional model in a virtual three-dimensional environment. At this time, the three-dimensional model presents a three-dimensional display effect, and the three-dimensional model under the three-dimensional display effect can be used for virtual reality interaction. Through the above technical means, the technical problem that the three-dimensional teaching model in the teaching courseware in the related technology cannot achieve the display effect of the model in the three-dimensional space when it is displayed in the two-dimensional space can be solved. By using a three-dimensional display application with virtual reality function and a teaching application to cooperate, when it is necessary to explain the three-dimensional model displayed in the teaching application, the three-dimensional display application can be used to display the three-dimensional model in the virtual three-dimensional environment, that is, to achieve the VR display effect, so that the user can immersively watch the three-dimensional model in the virtual three-dimensional environment, and then control the three-dimensional model in the virtual three-dimensional environment through VR interaction, so that the capabilities of the three-dimensional model are fully displayed, which is more conducive to the explanation and learning of the three-dimensional model, and ensures the teaching effect. Furthermore, the teaching application and the three-dimensional display application communicate via the network. During the communication process, HTTP is used to send notifications, and FTP is used to send data (such as three-dimensional models). This can reduce the installation restrictions on the teaching application and the three-dimensional display application. The teaching application and the three-dimensional display application can be installed in different physical entities, so that the range of devices that can be used as three-dimensional model display devices is wider, which is more conducive to the application and popularization of the three-dimensional model display method. Furthermore, the data related to the three-dimensional model in the teaching courseware can be the model entity of the three-dimensional model, and can also be the two-dimensional picture of the three-dimensional model and the model attachment associated with the two-dimensional picture, so that the state (entity state or picture state) of the three-dimensional model presented in the teaching courseware is richer. In particular, when it is impossible to insert the model entity in the teaching courseware, by inserting the two-dimensional picture and the model attachment associated with the two-dimensional picture, the three-dimensional model can be displayed in the teaching courseware. In addition, the three-dimensional model file can be associated with the two-dimensional picture as an attachment, and the file describing the three-dimensional model can also be included while displaying the three-dimensional model in the teaching courseware, so that the three-dimensional model can be obtained by drawing based on the three-dimensional model file later. The two-dimensional image and the model attachment are associated with each other through the MD5 value of the two-dimensional image. The accuracy of the two-dimensional image can also be guaranteed on the basis of establishing the association relationship, and there is no need to set other association codes for establishing the association relationship.

[0075] Figure 3 A flowchart of another 3D model display method provided for one embodiment of the present application. The 3D model display method mentioned here is based on the above 3D model display method, and exemplarily describes how a 3D display application obtains a 3D model. Figure 3The three-dimensional model display method includes steps 210 to 2100.

[0076] Step 210: Use the teaching application to play the teaching courseware, which contains data related to the three-dimensional model. The three-dimensional model corresponding to the data presents a planar display effect when the teaching courseware is played.

[0077] Step 220: Receive a 3D model display instruction.

[0078] Exemplarily, the three-dimensional model display instruction refers to an instruction manually issued and instructing to use virtual reality to display the three-dimensional model in the teaching courseware.

[0079] Among them, the generation method of the three-dimensional model display instruction is currently not limited. For example, when the teaching application plays the teaching courseware, the corresponding three-dimensional model display control is displayed in the playback interface. When it is detected that the control receives a set operation (such as a click operation), it is determined that the three-dimensional model display instruction has been received.

[0080] For example, Figure 4 A schematic diagram of a teaching courseware playback interface provided by an embodiment of the present application. Figure 4 , the teaching courseware is played in the interface 60, and the teaching courseware includes a three-dimensional model 61 and a three-dimensional model 62. The three-dimensional model 61 and the three-dimensional model 62 can be model entities or two-dimensional pictures. Currently, when the teaching courseware is played, the three-dimensional model 61 and the three-dimensional model 62 present a plane display effect. The interface 60 also displays a control 63, which is used to trigger the display of the three-dimensional model. When it is detected that the control 63 receives a click operation, it is determined that the three-dimensional model display instruction is received. Optionally, the three-dimensional model display device can detect the click operation and send the click operation to the teaching application. When the teaching application determines that the click operation acts on the control 63, it is determined that the three-dimensional model display instruction is received.

[0081] Step 230: The teaching application parses the data related to the three-dimensional model in the teaching courseware according to the three-dimensional model display instruction to obtain a model file for describing the three-dimensional model.

[0082] Exemplarily, after receiving the 3D model display instruction, the teaching application parses the data related to the 3D model in the teaching courseware. The method for implementing the parsing is not currently limited. For example, the teaching application can use COM component to parse the data related to the 3D model in the teaching courseware. The use of COM component to parse the data related to the 3D model is an open technology and is not described separately at present. For example, the COM component provided by Office has a technology for parsing the data related to the 3D model.

[0083] Currently, when the data related to the 3D model is a model entity of the 3D model, the teaching application parses the model entity to obtain a model file for describing the 3D model. When the data related to the 3D model is a 2D picture and associated model attachments, the teaching application parses the model attachments to obtain a model file for describing the 3D model.

[0084] Among them, the model file used to describe the three-dimensional model can be understood as a three-dimensional model file. Optionally, the teaching application can obtain a three-dimensional model file in a specific format. For example, the specific format is the GLB format. The three-dimensional model file in the GLB format is a three-dimensional model saved in the Graphics Language Transfer Format (glTF). When the teaching application parses the model entity, the model file in the GLB format can be obtained according to the node hierarchy, material, animation and / or mesh of the model entity. When the teaching application parses the model attachment, the model attachment is converted into a model file in the GLB format. For example, the model attachment is a three-dimensional model file in the STL format. When the teaching application parses the three-dimensional model file in the STL format, a model file in the GLB format is obtained.

[0085] Optionally, when the teaching courseware includes multiple three-dimensional models, each three-dimensional model has a corresponding model file.

[0086] Step 240: The teaching application sends a notification to display the 3D model to the 3D display application.

[0087] Currently, the teaching application sends a notification of displaying the 3D model to the 3D display application via HTTP.

[0088] Step 250: The 3D display application obtains the model file from the teaching application based on the notification.

[0089] Exemplarily, the 3D display application downloads the model file from the teaching application using FTP according to the notification of displaying the 3D model. Optionally, the 3D display application downloads the model files of all 3D models from the teaching application. Also optionally, the 3D display application downloads the model file of the 3D model displayed in the current interface from the teaching application.

[0090] Optionally, the 3D display application downloads the model file in GLB format.

[0091] Step 260: The 3D display application imports the model file.

[0092] Exemplarily, the 3D display application imports the model file, which can be understood as adding the 3D model corresponding to the model file in the 3D display application, so that the 3D model is displayed in the virtual 3D environment. The method of implementing the import is not currently limited. For example, the 3D display application imports the model file into the 3D display application through the gltf-unity plug-in. The gltf-unity plug-in can be understood as the GLTF plug-in provided by Unity, which belongs to the khronos open source project.

[0093] Step 270: The 3D display application parses the imported model file to obtain a 3D model.

[0094] For example, after the model file is imported into the 3D display application, the 3D display application can render the corresponding 3D model according to the model file to display the 3D model in the virtual 3D environment. The environment content used as the background in the virtual 3D environment is not currently limited.

[0095] In one embodiment, when parsing the model file, the three-dimensional display application also dynamically calculates the collision body according to the current actual needs of the user. The current three-dimensional model is composed of multiple sub-models, and the sub-model can also be understood as a sub-node model, which can be considered as the smallest object that constitutes the three-dimensional model. The three-dimensional model can be obtained by combining all the sub-models. In actual applications, some sub-models can also be combined to obtain a partial three-dimensional model. When calculating the collision body, it can be the collision body of the calculated three-dimensional model, the collision body of the sub-model, or the collision body of the partial three-dimensional model after the combination of some sub-models, which can be specifically selected by the user. At this time, step 270 may include steps 271-step 273:

[0096] Step 271: Receive a mode selection instruction.

[0097] In one embodiment, the three-dimensional display application has a synthesis mode and a disassembly mode. The synthesis mode refers to a mode in which each sub-model is combined into a three-dimensional model. In this case, the three-dimensional model is displayed in the three-dimensional display application in an integral manner, and the user can control the three-dimensional model as a whole. The disassembly mode refers to a mode in which the sub-models are not combined into a three-dimensional model. In this case, the three-dimensional model is displayed in the three-dimensional display application in a manner of displaying each sub-model, and the user can control each sub-model individually. Optionally, in the disassembly model, multiple disassembly degrees can be set. In the finest disassembly degree, each sub-model is not combined. In other disassembly degrees, each sub-model can be combined to a certain extent. For example, the three-dimensional model is a human body model. In the disassembly mode, when the user selects the finest disassembly degree, each finger of the human body can be controlled individually. When the user selects another disassembly degree, each finger of the left hand and the palm of the left hand can be combined to form the left hand hand can be controlled individually. When the user selects another disassembly degree, the palm, wrist, upper arm, elbow and forearm can be combined to form the arm can be controlled individually.

[0098] Optionally, when the 3D display application draws the 3D model based on the imported model file, the user may be prompted to select the currently required mode. Afterwards, when the user selects the currently required mode (i.e., synthesis mode or disassembly mode), the 3D display application may receive the corresponding mode selection instruction. The mode selection instruction includes the mode currently selected by the user, and whether the 3D model is disassembled can be determined based on the mode selection instruction. When the mode selection instruction is used to select the synthesis mode, step 272 is executed. When the mode selection instruction is used to select the disassembly mode, step 273 is executed.

[0099] Step 272: When the mode selection instruction is used to select the synthesis mode, the 3D display application determines the collision body of the 3D model according to the imported model file, and the collision body of the 3D model is used to realize the virtual reality interaction of the 3D model.

[0100] Exemplarily, in synthesis mode, the three-dimensional display application obtains the Renderer material information of all child nodes under the root node in the model file. Among them, the content of the root node and the child node can be determined according to the object represented by the three-dimensional model. For example, when the three-dimensional model is a human body, when the set root node represents the head of the human body, the corresponding child nodes may include cheeks, nose, eyes, mouth, etc. The overall three-dimensional model can be obtained by combining all the child nodes. When developing in Unity, it is a common operation to obtain materials through Renderer (rendering component). Therefore, the model file used in the embodiment records the material (material) in the Renderer of each child node. The material of the three-dimensional model is used to control the lighting and color performance of the surface texture of the three-dimensional model. In the embodiment, the Renderer material information refers to the specific content of the material in the Renderer of the child node.

[0101] Afterwards, the bounding box (bounds) of the material of the child node is obtained according to the Renderer material information of the child node. The bounding box can also be recorded as a bounding box. The bounding box contains boundary information related to the size of the corresponding three-dimensional model, that is, when the bounding box is displayed in a virtual three-dimensional environment, the corresponding three-dimensional model is displayed inside it. Currently, the corresponding child node in the three-dimensional model is displayed inside the bounding box. Taking the child node as a skeleton model as an example, the bounding box of the skeleton model can move with the movement of the skeleton model it contains. When the skeleton model rotates, the bounding box follows the rotation, and scales with the scaling of the skeleton model, but no matter how it is scaled, the bounding box always wraps the skeleton model. At present, obtaining the bounding box is a technical means that has been implemented and is not described separately at present.

[0102] After obtaining each bounding box, the bounding boxes corresponding to all the child nodes are taken as a union to obtain a bounding box covering the entire 3D model. It can be understood that the sub-models corresponding to each child node can be combined to obtain a 3D model. At this time, after taking the union of the bounding boxes corresponding to each child node, a large bounding box is obtained, and this large bounding box can be considered as the bounding box of the 3D model.

[0103] After obtaining each bounding box, the center position (Center) of each bounding box can be obtained. Optionally, the bounding box is located in the world coordinate system, so the coordinates of the center position of the bounding box are also in the world coordinate system. It can be understood that the world coordinate system currently referred to refers to the world coordinate system defined in the virtual three-dimensional environment. Afterwards, the center positions of all bounding boxes are calculated in pairs to obtain a center position, which can be considered as the center position of the bounding box covering the entire three-dimensional model. Among them, calculating the center positions of all bounding boxes in pairs can be understood as, the center positions of every two bounding boxes are a group, and the midpoint positions of the two are obtained. After that, every two midpoint positions are a group, and the midpoint positions corresponding to the two midpoint positions are continued to be obtained, and so on, until a midpoint position is finally obtained, and this midpoint position can be considered as the center position of the bounding box covering the entire three-dimensional model.

[0104] After that, according to the bounding box covering the entire 3D model and the corresponding center position, the collision body of the 3D model can be dynamically created, and the collision body is attached to the 3D model. Among them, in Unity, the dynamic creation of the collision body based on the bounding box and the center position of the bounding box is a technical means that has been realized and is not described separately at present. It can be understood that for the collision body, when the 3D model it contains moves, rotates, and scales, the collision body also moves, rotates, and scales accordingly. After the 3D model is attached to the collision body, the virtual reality interaction of the 3D model can be realized based on the collision body.

[0105] Step 273: When the mode selection instruction is used to select the disassembly mode, the 3D display application determines the collision body of each sub-model in the 3D model according to the imported model file, and the collision body of the sub-model is used to realize the virtual reality interaction of the sub-model.

[0106] In one embodiment, a description is given by taking the creation of collision bodies for each sub-model in the disassembly mode as an example. In the disassembly mode, the three-dimensional display application recursively traverses each node (root node and child node) in the model file. Among them, recursive traversal is a common traversal method for tree structures and is not described separately at present. During the traversal process, the node of the Renderer material component is found as the node of the sub-model. Among them, the Renderer material component can be understood as a Mesh Renderer component, which is a commonly used component in Unity. Currently, the node of the Renderer material component can also be understood as a child node with Renderer material information. Afterwards, the bounding box of the material of the node is obtained according to the Renderer material information of the node representing the sub-model. This process can refer to the process of obtaining the bounding box of the material of the sub-node according to the Renderer material information of the sub-node. Afterwards, the center position of the bounding box of the node representing the sub-model is obtained, and the collision body of the sub-model is dynamically created according to the bounding box of the node and the center position of the bounding box, and the collision body can be attached to the sub-model. This process can refer to the process of dynamically creating a collision body of a three-dimensional model according to the bounding box covering the entire three-dimensional model and the corresponding center position.

[0107] It can be understood that after each sub-model is attached with a corresponding collision body, virtual reality interaction of the sub-model can be realized based on the collision body.

[0108] Optionally, after the 3D display application determines that the disassembly mode is selected, it can display the currently set disassembly degrees, then obtain the disassembly degree selected by the user, and construct a corresponding collision body according to the disassembly degree selected by the user. For example, when it is determined according to the disassembly degree that the sub-models need to be merged into a partial 3D model, the 3D display application can take the union of the bounding boxes of these sub-models to obtain the bounding box of the partial 3D model, and obtain the center position of the bounding box of the partial 3D model according to the center position of the bounding boxes of these sub-models, and then obtain the collision body of the partial 3D model according to the bounding box of the partial 3D model and the corresponding center position.

[0109] Step 280: The three-dimensional display application displays the three-dimensional model in the virtual three-dimensional environment, and the three-dimensional model presents a three-dimensional display effect in the three-dimensional display application to realize virtual reality interaction.

[0110] For example, when a 3D display application displays a 3D model, a collision body can also be displayed. For example, in the synthesis mode, the collision body of the entire 3D model is displayed. In the disassembly mode, the collision body of each sub-model in the 3D model or a part of the 3D model combined with each sub-model is displayed.

[0111] Step 290: The three-dimensional display application receives a model control instruction sent by an interactive device, where the interactive device is a virtual reality control device.

[0112] After the 3D display application displays the 3D model, the user can use the interactive device associated with the 3D model display device to perform virtual reality control on the 3D model. In this case, the interactive device can be considered as a virtual reality control device.

[0113] When the user uses the interactive device to realize virtual reality control, the interactive device can simulate the emission of rays in the virtual three-dimensional environment, and the position pointed by the ray can be adjusted by the user. The ray is used to detect the collision body, and then the user can use the interactive device to control the three-dimensional model or sub-model contained in the collision body detected by the ray. During control, the instructions issued by the user through the interactive device are recorded as model control instructions. Model control instructions can be used to realize operations such as rotation, movement, and scaling. Afterwards, the interactive device sends the model control instructions to the three-dimensional model display device, and then the three-dimensional model display device sends the model control instructions to the three-dimensional display application.

[0114] For example, Figure 5 A schematic diagram of displaying a three-dimensional model in a virtual three-dimensional environment provided by an embodiment of the present application. Figure 5 , which shows the display content viewed by the user when the 3D display application displays the 3D model in the virtual 3D environment. Figure 5 It can be understood as a three-dimensional display application acquisition Figure 4 The display effect of the 3D model when it is displayed in a virtual 3D environment is shown in the 3D model in the teaching courseware.

[0115] It can be understood that in actual applications, users view the 3D model in the virtual 3D environment based on the 3D model display device. Figure 5 Just to facilitate understanding of the technical solution, a screenshot of the display interface seen by the user is taken and the screenshot is displayed in two dimensions to determine the display content viewed by the user. Figure 5 It can be seen that the user can control the three-dimensional model through the ray 72.

[0116] Optionally, the 3D display application can highlight the model contained in the collision volume detected by the ray, so that the user can clearly know the 3D model that can be currently controlled. Figure 5 In the example, the display effect of the sub-model 71 included in the collision body detected by the ray is different from that of other sub-models. At this time, the user can clearly identify the sub-model that is currently controllable.

[0117] Step 2100: The 3D display application performs corresponding control operations on the 3D model in the virtual 3D environment according to the model control instruction.

[0118] After receiving the model control instruction, the 3D display application parses the model control instruction to obtain the specific instruction content of the model control instruction, and then performs control operations on the 3D model according to the instruction content. It can be understood that when the collision body detected by the ray includes a sub-model, performing corresponding control operations on the 3D model can be understood as performing control operations on the sub-model, such as controlling the rotation, scaling or movement of the sub-model. When the collision body detected by the ray includes the entire 3D model, performing corresponding control operations on the 3D model can be understood as performing control operations on the entire 3D model, such as controlling the rotation, scaling or movement of the 3D model.

[0119] It should be noted that in the embodiment, a 3D display application is used to display a 3D model in a virtual 3D environment as an example. In actual applications, the teaching application can also take screenshots of the teaching courseware, and then obtain the text, picture, video, audio, and 3D model data in the screenshot, and then send all this data to the 3D display application. The 3D display application can display the 3D model in the virtual 3D environment. At the same time, a player or UI control can be added to the virtual 3D environment to play text, pictures, videos, audio, etc. in the virtual 3D environment, thereby restoring all the contents of the current interface of the teaching courseware in the virtual 3D environment, so as to better display the teaching courseware.

[0120] In the above embodiment, when a teaching application is used to play a teaching courseware containing data related to a three-dimensional model, the three-dimensional model presents a plane display effect, that is, the three-dimensional model is displayed in a two-dimensional space. Afterwards, when a three-dimensional model display instruction is received, the teaching application parses the data related to the three-dimensional model in the teaching courseware, obtains a model file for describing the three-dimensional model, and notifies the three-dimensional display application to display the three-dimensional model. The three-dimensional display application obtains the model file from the teaching application according to the notification of the teaching application, and then imports the model file into the three-dimensional display application to obtain the three-dimensional model by parsing the model file, and then displays the three-dimensional model in a virtual three-dimensional environment. Afterwards, the three-dimensional display application performs corresponding control operations on the three-dimensional model in the virtual three-dimensional environment according to the model control instruction sent by the interactive device. Through the above-mentioned technical means, the technical problem that the three-dimensional teaching model in the teaching courseware cannot achieve the display effect of the model in the three-dimensional space when it is displayed in the two-dimensional space in the related technology can be solved. By using a three-dimensional display application with virtual reality function and a teaching application to cooperate, when it is necessary to explain the three-dimensional model displayed in the teaching application, the three-dimensional display application can be used to display the three-dimensional model in a virtual three-dimensional environment, that is, to achieve VR display effect, so that the user can immersively watch the three-dimensional model in the virtual three-dimensional environment, and the user can control the three-dimensional model in the virtual three-dimensional environment through an interactive device, so that the capabilities of the three-dimensional model are fully displayed, which is more conducive to the explanation and learning of the three-dimensional model and ensures the teaching effect. In addition, the teaching application can obtain a model file for describing the three-dimensional model by using the model parsing ability, so that the three-dimensional display application can render the three-dimensional model based on the model file in the virtual three-dimensional environment, so that the implementation method of the three-dimensional display application and the teaching application when displaying the three-dimensional model is simple and accurate, and is easy to promote and use. In addition, when the three-dimensional display application renders the three-dimensional model, it can create collision bodies for different model objects (three-dimensional models or sub-models) based on the synthesis mode and disassembly mode selected by the user, so that the currently displayed three-dimensional model is more in line with the actual operation needs of the user, so that the user can better operate the three-dimensional model, and further improve the teaching effect when using teaching courseware for teaching.

[0121] Figure 6 A flowchart of another 3D model display method provided for an embodiment of the present application. The 3D model display method described herein is based on the aforementioned embodiment and is an exemplary description of how to make teaching courseware. Currently, the description is given by taking the insertion of a 2D picture of a 3D model and associated model attachments into the teaching courseware as an example. Figure 6 The three-dimensional model display method includes steps 310 to 390.

[0122] Step 310: Use a courseware making application to make teaching courseware, and during the making process, receive a three-dimensional model insertion instruction.

[0123] Exemplarily, an application that can produce teaching courseware is recorded as a courseware production application. For example, Word, PPT, and WPS in Microsoft Office can all be used as courseware production applications. Optionally, the courseware production application and the teaching application can be the same application or different applications. Currently, the courseware production application and the teaching application are described as different applications.

[0124] It is understandable that the courseware making application can be installed in the three-dimensional model display device, or can be installed in other electronic devices. Currently, the courseware making application is installed in the three-dimensional model display device as an example for description.

[0125] When a user uses a courseware making application to make teaching courseware, if a 3D model needs to be inserted into the teaching courseware, a 3D model insertion instruction can be issued in the courseware making application. The 3D model insertion instruction is used to notify the courseware making application that a 3D model needs to be inserted. The method for generating the 3D model insertion instruction is not currently limited. For example, when the courseware making application detects that a control for inserting a 3D model is selected, it determines that a 3D model insertion instruction has been received.

[0126] It should be noted that the user who uses the courseware production application and the user who uses the teaching application can be the same user or different users.

[0127] Step 320: The courseware production application obtains the 3D model catalog from the 3D model library through the model plug-in according to the 3D model insertion instruction, and the model plug-in is embedded in the courseware production application.

[0128] It is understandable that Microsoft Office 2019 and later versions have the ability to directly insert a 3D model (supporting formats such as obj, fbx, stl, and ply) into the currently edited file (i.e., teaching courseware). At this time, after the courseware production application receives the 3D model insertion instruction, it can insert the model entity of the 3D model into the currently edited file by inserting an attachment. Since this is an existing function, it is not described separately in the embodiment.

[0129] WPS and Microsoft Office versions prior to 2019 do not have the ability to directly insert 3D models. In this case, you can insert 3D models by inserting 2D images of the 3D model and the associated model attachments. It should be noted that Microsoft Office 2019 and later versions can also insert 3D models in this way.

[0130] In one embodiment, the open capability of the third-party plug-in of the courseware production application can be used to produce a model plug-in that can insert a 3D model. After the model plug-in is embedded in the courseware production application, the courseware production application calls the model plug-in according to the 3D model insertion instruction to insert the 2D image of the 3D model and the associated model attachments into the teaching courseware through the model plug-in. In an optional manner, the model plug-in can be implemented based on the open technology of the COM component.

[0131] Figure 7 An example diagram of a data transmission path related to a three-dimensional model provided in an embodiment of the present application, refer to Figure 7 After the courseware making application calls the model plug-in 81, the model plug-in 81 can access the 3D model library 82 to obtain the 3D model directory. The 3D model library stores resources of multiple 3D models. In one embodiment, the 3D model library stores 2D images of each 3D model and the original model files of the 3D model.

[0132] The 3D model library can be stored in the 3D model display device, or in a cloud platform (i.e., cloud computing platform) accessible to the 3D model display device. Currently, taking the 3D model library stored in the cloud platform as an example, the 3D model library can also be recorded as a 3D model resource cloud platform. At this time, the model plug-in accesses the 3D model library, which can be considered as accessing online resources.

[0133] The 3D model directory can also be understood as an online resource list. The 3D model directory records the names and / or numbers of the 3D models that can be currently obtained, and can also record the format, thumbnail and other contents of the 3D models. The 3D model directory is provided by the 3D model library. After the model plug-in obtains the 3D model directory, it can display the 3D model directory in the courseware production application for users to select.

[0134] Optionally, the model plug-in can transmit instructions and data to the three-dimensional model library through the network, and the protocol used for the transmission is currently not limited.

[0135] Step 330: Receive a 3D model selection instruction, where the 3D model selection instruction is used to select a 3D model to be inserted in the 3D model catalog.

[0136] Exemplarily, a user of the courseware making application can select a 3D model that needs to be inserted in the 3D model catalog. In an embodiment, the user's instruction to select a 3D model is recorded as a 3D model selection instruction. After the model plug-in detects that the content of a 3D model in the 3D model catalog is selected, it determines that the 3D model selection instruction has been received.

[0137] Step 340: The model plug-in obtains the two-dimensional image of the three-dimensional model corresponding to the three-dimensional model selection instruction and the model attachments associated with the two-dimensional image from the three-dimensional model library.

[0138] Exemplary, reference Figure 7 The model plug-in downloads the corresponding 3D model resources from the 3D model library according to the 3D model selection operation. Currently, the downloaded resources include the 2D image of the 3D model and the original model file of the 3D model. In addition, the original model file is used as an attachment of the 2D image, that is, as a model attachment.

[0139] Optionally, the two-dimensional image of the three-dimensional model in the three-dimensional database and the original model file (i.e., the three-dimensional model file generated when the three-dimensional model is created) are associated through the MD5 value of the two-dimensional image. In this case, the two-dimensional image downloaded by the model plug-in and the original model file have an associated relationship. Also optionally, the two-dimensional image of the three-dimensional model in the three-dimensional database and the original model file have no associated relationship. In this case, after the model plug-in downloads the two-dimensional image and the original model file, it calculates the MD5 value of the two-dimensional image and establishes an association between the two-dimensional image and the original model file through the MD5 value.

[0140] Step 350: The model plug-in inserts the two-dimensional image and the model attachment into the teaching courseware. The two-dimensional image is displayed in the teaching courseware, and the model attachment is hidden in the teaching courseware.

[0141] Exemplarily, after the model plug-in obtains the two-dimensional image and the original model file, it inserts the two-dimensional image into the currently produced teaching courseware, so that when the teaching application plays the teaching courseware, the user can view the inserted two-dimensional image. In addition, the model plug-in also hides the original model file as a model attachment of the two-dimensional image in the teaching courseware. When the teaching application opens the teaching courseware, the attachment hidden in the teaching courseware can be obtained synchronously.

[0142] Figure 8 A schematic diagram of a teaching courseware production interface provided for an embodiment of the present application. Figure 8 The interface after inserting a two-dimensional picture and a model attachment into the teaching courseware is shown. At this time, the teaching courseware only displays the currently inserted two-dimensional picture and does not display the corresponding model attachment.

[0143] After the teaching courseware is produced, the teaching courseware can be applied, that is, steps 360 to 390 are executed to realize virtual reality interaction of the three-dimensional model when applying the teaching courseware.

[0144] Optionally, if the courseware making application and the teaching application are both installed in the 3D model display device, then after the user uses the courseware making application to make the teaching courseware, the teaching courseware can be saved in the 3D model display device, and then the teaching application can open the stored teaching courseware. Alternatively, the teaching courseware can also be stored in a U disk or a network disk, and then the teaching application can access the U disk or the network disk to open the teaching courseware stored therein.

[0145] Step 360: Use the teaching application to play the teaching courseware, which contains data related to the three-dimensional model. The three-dimensional model corresponding to the data presents a planar display effect when the teaching courseware is played.

[0146] Step 370: The teaching application sends a notification to display the 3D model to the 3D display application.

[0147] Step 380: The three-dimensional display application obtains the three-dimensional model corresponding to the data from the teaching application based on the notification.

[0148] Step 390: The three-dimensional display application displays the three-dimensional model in the virtual three-dimensional environment, and the three-dimensional model presents a three-dimensional display effect in the three-dimensional display application to realize virtual reality interaction.

[0149] In the above embodiment, when making teaching courseware in the courseware making application, the three-dimensional model library can be accessed through the model plug-in, and then the two-dimensional picture and model attachment of the three-dimensional model in the model database can be obtained. After that, the model plug-in inserts the two-dimensional picture and the model attachment into the teaching courseware to realize the display of the three-dimensional model in the teaching courseware. In particular, when the courseware making application does not have the function of inserting the three-dimensional model, the three-dimensional model to be inserted can be displayed in the teaching courseware by inserting the two-dimensional picture, so as to expand the scope of the application program that can be used as the courseware making application. In addition, the model attachment associated with the two-dimensional picture is also inserted into the teaching courseware, so that the teaching courseware can contain the file for describing the three-dimensional model, which is convenient for using the teaching courseware for teaching, so that the three-dimensional display application renders the corresponding three-dimensional model based on the model attachment.

[0150] Fig. 9 A schematic diagram of the structure of a three-dimensional model display device provided by an embodiment of the present application. Fig. 9 The three-dimensional model display device includes: a playing unit 401, a sending unit 402, a first obtaining unit 403 and a display unit 404.

[0151] Among them, the playback unit 401 is used to use the teaching application to play the teaching courseware, and the teaching courseware contains data related to the three-dimensional model. The three-dimensional model corresponding to the data presents a plane display effect when the teaching courseware is played. The sending unit 402 is used for the teaching application to send a notification to display the three-dimensional model to the three-dimensional display application. The first acquisition unit 403 is used to enable the three-dimensional display application to obtain the three-dimensional model corresponding to the data from the teaching application based on the notification. The display unit 404 is used to enable the three-dimensional display application to display the three-dimensional model in a virtual three-dimensional environment, and the three-dimensional model presents a three-dimensional display effect in the three-dimensional display application for realizing virtual reality interaction.

[0152] In one embodiment of the present application, the data related to the three-dimensional model includes a two-dimensional image of the three-dimensional model and model attachments associated with the two-dimensional image, or the data related to the three-dimensional model includes a model entity of the three-dimensional model.

[0153] In one embodiment of the present application, when the data related to the three-dimensional model includes a two-dimensional picture of the three-dimensional model and a model attachment associated with the two-dimensional picture, the device further includes: a first receiving unit, which is used to use a courseware production application to produce teaching courseware, and during the production process, receives a three-dimensional model insertion instruction. A second acquisition unit, which is used to enable the courseware production application to obtain a three-dimensional model directory from a three-dimensional model library through a model plug-in according to the three-dimensional model insertion instruction, and the model plug-in is embedded in the courseware production application. The second receiving unit is used to receive a three-dimensional model selection instruction, and the three-dimensional model selection instruction is used to select an inserted three-dimensional model in the three-dimensional model directory. A third acquisition unit, which is used to enable the model plug-in to obtain a two-dimensional picture of the three-dimensional model corresponding to the three-dimensional model selection instruction and a model attachment associated with the two-dimensional picture from the three-dimensional model library. An insertion unit, which is used to enable the model plug-in to insert the two-dimensional picture and the model attachment in the teaching courseware, and the two-dimensional picture is displayed in the teaching courseware, and the model attachment is hidden in the teaching courseware.

[0154] In one embodiment of the present application, the two-dimensional image and the corresponding model attachment are associated through the MD5 value of the two-dimensional image.

[0155] In one embodiment of the present application, the device further includes: a third receiving unit, which is used to receive a three-dimensional model display instruction before the teaching application sends a notification of displaying the three-dimensional model to the three-dimensional display application. A parsing unit, which is used to enable the teaching application to parse the data related to the three-dimensional model in the teaching courseware according to the three-dimensional model display instruction to obtain a model file for describing the three-dimensional model. The first acquisition unit 403 includes: a file acquisition subunit, which is used to enable the three-dimensional display application to obtain a model file from the teaching application based on the notification. A file import subunit, which is used to enable the three-dimensional display application to import a model file. A file parsing subunit, which is used to enable the three-dimensional display application to parse the imported model file to obtain the three-dimensional model.

[0156] In one embodiment of the present application, the three-dimensional model is composed of multiple sub-models, and the file parsing sub-unit includes: an instruction receiving grandchild unit, which is used to receive a mode selection instruction; a first collision body determination grandchild unit, which is used to enable the three-dimensional display application to determine the collision body of the three-dimensional model according to the imported model file when the mode selection instruction is used to select the synthesis mode, and the collision body of the three-dimensional model is used to realize virtual reality interaction with the three-dimensional model; a second collision body determination grandchild unit, which is used to enable the three-dimensional display application to determine the collision body of each sub-model in the three-dimensional model according to the imported model file when the mode selection instruction is used to select the disassembly mode, and the collision body of the sub-model is used to realize virtual reality interaction with the sub-model.

[0157] In one embodiment of the present application, the sending unit 402 is specifically used to: the teaching application sends a notification of displaying the three-dimensional model to the three-dimensional display application through the hypertext transfer protocol. Correspondingly, the first acquisition unit 403 is specifically used to: enable the three-dimensional display application to obtain the three-dimensional model corresponding to the data from the teaching application through the file transfer protocol based on the notification.

[0158] In one embodiment of the present application, the device further includes: a fourth receiving unit, configured to enable the 3D display application to receive a model control instruction sent by an interactive device after the 3D display application displays the 3D model in the virtual 3D environment, wherein the interactive device is a virtual reality control device. An execution unit, configured to enable the 3D display application to perform a corresponding control operation on the 3D model in the virtual 3D environment according to the model control instruction.

[0159] The three-dimensional model display device provided in the embodiments of the present application can be used to execute the three-dimensional model display method provided in any of the above embodiments, and has corresponding functions and beneficial effects.

[0160] It is worth noting that in the embodiment of the above-mentioned three-dimensional model display device, the various units and modules included are only divided according to functional logic, but are not limited to the above-mentioned division, as long as the corresponding functions can be achieved; in addition, the specific names of the functional units are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of the present invention.

[0161] Fig.10 A schematic diagram of the structure of a three-dimensional model display device provided by an embodiment of the present application. Fig.10 The three-dimensional model display device includes a processor 501, a memory 502 and a display screen 503. The processor 501, the memory 502 and the display screen 503 are connected via a communication bus 504. In practical applications, the processor 501, the memory 502 and the display screen 503 can also be connected via other types of transmission lines. The number of processors 501 can be one or more. Fig.10 A processor 501 is taken as an example.

[0162] The processor 501 may include processing units such as an application processor (AP), a graphics processing unit (GPU) and a central processing unit (CPU).

[0163] The memory 502 is a computer-readable storage medium that can be used to store software programs, computer executable programs and modules, such as program instructions / modules corresponding to the three-dimensional model display method in the embodiment of the present disclosure. The processor 501 executes various functional applications and data processing of the three-dimensional model display device by running the software programs, instructions and modules stored in the memory 502, that is, implements the above-mentioned three-dimensional model display method.

[0164] The memory 502 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system and at least one application required for a function; the data storage area may store data created according to the use of the three-dimensional model display device, etc. In addition, the memory 502 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other non-volatile solid-state storage device. In some instances, the memory 502 may further include a memory remotely arranged relative to the processor 501, and these remote memories may be connected to the three-dimensional model display device via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0165] The display screen 502 may be a liquid crystal display (Liquid Crystal Display), an LED display (LEDdisplay), an organic light-emitting diode (OLED) display screen, or a flexible light-emitting diode (FLED) display screen, etc. In addition, the display screen 502 may be a straight screen or a curved screen, as long as it is ensured that when the three-dimensional display application displays the three-dimensional model, the user can see the display effect of virtual reality.

[0166] In addition, the 3D model display device may also include an input device, an output device, a communication device, etc. Among them, the input device can be used to receive input digital or character information, and generate key signal input related to user settings and function control of the 3D model display device. The output device may include an audio player, etc. The communication device is used to achieve communication with other devices.

[0167] Currently, the 3D model display device has the function of virtual reality, and can realize virtual reality interaction with the 3D model through an adapted interactive device. The 3D model display device can be a physical entity, such as a 3D model display device can be a VR all-in-one machine or a desktop VR interactive all-in-one machine. The 3D model display device can be multiple physical entities, such as a 3D model display device including at least a VR device and an electronic device.

[0168] The above-mentioned three-dimensional model display equipment also includes a three-dimensional model display device, which can be used to execute the three-dimensional model display method and has corresponding functions and beneficial effects.

[0169] An embodiment of the present invention also provides a storage medium containing computer executable instructions, which, when executed by a computer processor, are used to perform relevant operations in the three-dimensional model display method provided in any embodiment of the present application, and have corresponding functions and beneficial effects.

[0170] Those skilled in the art should understand that the embodiments of the present application may be provided as methods, systems, or computer program products.

[0171] Therefore, the present application may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the present application may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code. The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the functions in the process. Figure 1 A process or multiple processes and / or boxes Figure 1 These computer program instructions can also be stored in a computer-readable memory that can guide a computer or other programmable data processing device to work in a specific way, so that the instructions stored in the computer-readable memory produce a product including an instruction device, which implements the functions specified in the process. Figure 1 A process or multiple processes and / or boxes Figure 1 These computer program instructions can also be loaded onto a computer or other programmable data processing device, so that a series of operation steps are executed on the computer or other programmable device to produce a computer-implemented process, so that the instructions executed on the computer or other programmable device provide for implementing the process in the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0172] In a typical configuration, a computing device includes one or more processors (CPU), input / output interfaces, network interfaces, and memory. The memory may include non-permanent memory in a computer-readable medium, random access memory (RAM) and / or non-volatile memory in the form of read-only memory (ROM) or flash RAM. The memory is an example of a computer-readable medium.

[0173] Computer readable media include permanent and non-permanent, removable and non-removable media that can be implemented by any method or technology to store information. Information can be computer readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer readable media does not include temporary computer readable media (transitory media), such as modulated data signals and carrier waves.

[0174] It should also be noted that the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, commodity or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, commodity or device. In the absence of more restrictions, the elements defined by the sentence "comprises a ..." do not exclude the existence of other identical elements in the process, method, commodity or device including the elements.

[0175] Note that the above are only preferred embodiments of the present application and the technical principles used. Those skilled in the art will understand that the present application is not limited to the specific embodiments described herein, and that various obvious changes, readjustments and substitutions can be made by those skilled in the art without departing from the scope of protection of the present application. Therefore, although the present application is described in more detail through the above embodiments, the present application is not limited to the above embodiments, and may include more other equivalent embodiments without departing from the concept of the present application, and the scope of the present application is determined by the scope of the appended claims.

Claims

1. A three-dimensional model display method, characterized in that: include: Playing teaching courseware using a teaching application, wherein the teaching courseware includes data related to a three-dimensional model, and the three-dimensional model corresponding to the data presents a plane display effect when the teaching courseware is played; The teaching application sends a notification to display the three-dimensional model to the three-dimensional display application; The three-dimensional display application obtains the three-dimensional model corresponding to the data from the teaching application based on the notification; The three-dimensional display application displays the three-dimensional model in a virtual three-dimensional environment, and the three-dimensional model presents a three-dimensional display effect in the three-dimensional display application to realize virtual reality interaction.

2. The three-dimensional model display method according to claim 1, characterized in that: The data related to the three-dimensional model includes a two-dimensional picture of the three-dimensional model and model attachments associated with the two-dimensional picture, or the data related to the three-dimensional model includes a model entity of the three-dimensional model.

3. The three-dimensional model display method according to claim 2, characterized in that: When the data related to the three-dimensional model includes a two-dimensional picture of the three-dimensional model and model attachments associated with the two-dimensional picture, the method further includes: Using a courseware making application to make the teaching courseware, and during the making process, receiving a three-dimensional model insertion instruction; The courseware making application obtains the 3D model catalog from the 3D model library through a model plug-in according to the 3D model insertion instruction, and the model plug-in is embedded in the courseware making application; receiving a three-dimensional model selection instruction, wherein the three-dimensional model selection instruction is used to select an inserted three-dimensional model in the three-dimensional model catalog; The model plug-in obtains, from the three-dimensional model library, a two-dimensional image of the three-dimensional model corresponding to the three-dimensional model selection instruction and a model attachment associated with the two-dimensional image; The model plug-in inserts the two-dimensional picture and the model attachment into the teaching courseware, the two-dimensional picture is displayed in the teaching courseware, and the model attachment is hidden in the teaching courseware.

4. The three-dimensional model display method according to claim 2 or 3, characterized in that: The two-dimensional image and the corresponding model attachment are associated through the MD5 value of the two-dimensional image.

5. The three-dimensional model display method according to claim 1, characterized in that: Before the teaching application sends a notification to the three-dimensional display application to display the three-dimensional model, the method further includes: Receive a three-dimensional model display instruction; The teaching application parses the data related to the three-dimensional model in the teaching courseware according to the three-dimensional model display instruction to obtain a model file for describing the three-dimensional model; The three-dimensional display application obtains the three-dimensional model corresponding to the data from the teaching application based on the notification, including: The three-dimensional display application obtains the model file from the teaching application based on the notification; The three-dimensional display application imports the model file; The three-dimensional display application parses the imported model file to obtain the three-dimensional model.

6. The three-dimensional model display method according to claim 5, characterized in that: The three-dimensional model is composed of multiple sub-models. The three-dimensional display application parses the imported model file to obtain the three-dimensional model, including: Receive mode selection command; When the mode selection instruction is used to select a synthesis mode, the three-dimensional display application determines a collision body of the three-dimensional model according to the imported model file, and the collision body of the three-dimensional model is used to realize virtual reality interaction with the three-dimensional model; When the mode selection instruction is used to select the disassembly mode, the three-dimensional display application determines the collision body of each sub-model in the three-dimensional model according to the imported model file, and the collision body of the sub-model is used to realize the virtual reality interaction with the sub-model.

7. The three-dimensional model display method according to claim 1, characterized in that: The sending of a notification of displaying the three-dimensional model by the teaching application to the three-dimensional display application includes: The teaching application sends a notification of displaying the three-dimensional model to the three-dimensional display application through the hypertext transfer protocol; The three-dimensional display application obtains the three-dimensional model corresponding to the data from the teaching application based on the notification, including: Based on the notification, the three-dimensional display application obtains the three-dimensional model corresponding to the data from the teaching application through a file transfer protocol.

8. The three-dimensional model display method according to claim 1, characterized in that: After the three-dimensional display application displays the three-dimensional model in the virtual three-dimensional environment, the method includes: The three-dimensional display application receives a model control instruction sent by an interactive device, wherein the interactive device is a virtual reality control device; The three-dimensional display application performs corresponding control operations on the three-dimensional model in the virtual three-dimensional environment according to the model control instructions.

9. A three-dimensional model display device, characterized in that: include: A playback unit, used to play teaching courseware using a teaching application, wherein the teaching courseware includes data related to a three-dimensional model, and the three-dimensional model corresponding to the data presents a plane display effect when the teaching courseware is played; A sending unit, configured to send a notification for displaying the three-dimensional model from the teaching application to the three-dimensional display application; A first acquisition unit, configured to enable the three-dimensional display application to acquire a three-dimensional model corresponding to the data from the teaching application based on the notification; The display unit is used to enable the three-dimensional display application to display the three-dimensional model in a virtual three-dimensional environment, and the three-dimensional model presents a three-dimensional display effect in the three-dimensional display application to realize virtual reality interaction.

10. A three-dimensional model display device, characterized in that: include: one or more processors; A memory for storing one or more programs; When the one or more programs are executed by the one or more processors, the one or more processors implement the three-dimensional model display method as described in any one of claims 1-8.

11. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the three-dimensional model display method as described in any one of claims 1 to 8 is implemented.

Images