Model cognition method based on virtual reality, terminal equipment and storage medium

Abstract

The invention provides a virtual reality-based model cognition method, terminal equipment and a storage medium, and the method comprises the steps: obtaining a three-dimensional model selected by a user, the three-dimensional model comprising a plurality of components; generating a plurality of projection views corresponding to the three-dimensional model, wherein the projection views consist of component views of visible components in the plurality of components in the projection direction; displaying the three-dimensional model on a display screen based on a virtual reality technology, and displaying the plurality of projection views on the display screen; and after successful display, when any component in the three-dimensional model is selected, highlighting the selected component, and highlighting the component view corresponding to the selected component in the plurality of projection views. Therefore, the generated projection view is more accurate, the three-dimensional model is displayed based on the virtual reality technology, if a certain component is selected in the display process, the component is highlighted, corresponding highlighting is carried out in the projection view, and the learning effect of model cognition can be improved.

Description

Technical Field

[0001] The present application relates to the field of virtual reality technology, and in particular to a model recognition method, terminal device, and storage medium based on virtual reality. Background Art

[0002] Model recognition is a fundamental skill required in fields like mechanical design and manufacturing, leading many universities to offer specialized courses in this area, such as engineering drawing. However, current model recognition instruction relies solely on text-based instruction. Therefore, both the teacher's explanation and the student's understanding require strong spatial visualization skills. Consequently, this approach significantly impacts instructional quality and reduces student learning outcomes. Summary of the Invention

[0003] Based on this, the present application provides a model recognition method, terminal device and storage medium based on virtual reality to improve the learning effect of model recognition.

[0004] In a first aspect, the present application provides a model recognition method based on virtual reality, comprising:

[0005] Acquire a three-dimensional model selected by a user; wherein the three-dimensional model includes a plurality of components;

[0006] Generating a plurality of projection views corresponding to the three-dimensional model; wherein the projection views are composed of component views of visible components in the projection directions of the plurality of components;

[0007] Displaying the three-dimensional model on a display screen based on virtual reality technology, and displaying the plurality of projection views on the display screen;

[0008] After successful display, when any component in the three-dimensional model is selected, the selected component is highlighted, and the component view corresponding to the selected component is highlighted in the plurality of projection views.

[0009] In the virtual reality-based model recognition method of the present application, the step of obtaining the three-dimensional model selected by the user includes:

[0010] In response to a user's model import operation, obtaining a three-dimensional model selected by the user; or providing multiple preset three-dimensional models for the user to select, and obtaining the three-dimensional model selected by the user;

[0011] And / or, the plurality of projection views include a part or all of the six views.

[0012] In the virtual reality-based model recognition method of the present application, the display attributes of each of the components are different;

[0013] Generating a plurality of projection views corresponding to the three-dimensional model includes:

[0014] Repeat the following steps until the plurality of projection views are generated: determine a projection direction, identify visible components in the plurality of components in the projection direction, and generate component views of the visible components in the projection direction to form projection views.

[0015] In the virtual reality-based model recognition method of the present application, the display attributes of the component include color and / or style.

[0016] In the virtual reality-based model recognition method of the present application, identifying the visible components in the projection direction among the multiple components includes:

[0017] determining display attributes visible in the projection direction;

[0018] According to the visible display attribute, a visible component in the projection direction among the multiple components is identified.

[0019] In the virtual reality-based model recognition method of the present application, after generating a plurality of projection views corresponding to the three-dimensional model, the method further includes:

[0020] Associating the component view in the projection view with the component in the three-dimensional model to suggest an association relationship;

[0021] When any component in the three-dimensional model is selected, the selected component is highlighted, and component views corresponding to the selected component are highlighted in the plurality of projection views, including:

[0022] When any component in the three-dimensional model is selected, highlighting the selected component;

[0023] According to the association relationship, the component views associated with the selected component in the plurality of projection views are highlighted.

[0024] In the virtual reality-based model recognition method of the present application, the highlighting process includes displaying and / or highlighting the selected component using the display attributes of the selected component.

[0025] In the model recognition method based on virtual reality of the present application, after the successful display, the method further includes:

[0026] If it is detected that any one of the several projection views is selected, the three-dimensional model is centered and the side of the three-dimensional model corresponding to the projection direction of the selected projection view is displayed positively, and the remaining projection views of the several projection views are hidden.

[0027] In a second aspect, the present application provides a terminal device, including a processor and a memory;

[0028] The memory is used to store computer programs;

[0029] The processor is configured to execute the computer program and implement the virtual reality-based model recognition method as described in any one of the first aspects when executing the computer program.

[0030] In a third aspect, the present application provides a computer-readable storage medium storing a computer program, which, when executed by a processor, enables the processor to implement the virtual reality-based model recognition method as described in any one of the first aspects.

[0031] In the above technical solution, on the one hand, since the three-dimensional model includes multiple components and the display properties of each component are different, after determining the projection direction, the visible components can be determined according to the display properties seen, and then the component views of each visible component can be generated separately to obtain the corresponding projection views. Therefore, it can be understood that determining the visible components according to the display properties and then obtaining the projection views by generating component views of each visible component is a more accurate projection view; on the other hand, displaying the three-dimensional model based on virtual reality technology allows users to experience a more realistic 3D effect, and during the display process, if a component is selected, the component is highlighted and correspondingly highlighted in the projection view, forming a correspondence, which is more friendly to model cognition and can improve the learning effect of model cognition. BRIEF DESCRIPTION OF THE DRAWINGS

[0032] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the following is a brief introduction to the drawings required for use in the description of the embodiments. Obviously, the drawings described below are some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0033] Figure 1 A flowchart of a virtual reality-based model recognition method provided in an embodiment of the present application;

[0034] Figure 2 Schematic diagram of another flow chart of the model recognition method based on virtual reality in an embodiment of the present application;

[0035] Figure 3 A schematic diagram of the structure of a terminal device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0036] Current model cognition teaching relies solely on text-based teaching materials. Therefore, both the teacher's explanation and the students' understanding require strong spatial imagination. Consequently, this teaching method significantly impacts teaching quality and reduces students' learning outcomes in model cognition.

[0037] Virtual reality technology utilizes computer technology to generate a simulated environment through interactive, three-dimensional dynamic visuals and systematic simulation of entity behaviors by fusing multi-source information. The system then presents the corresponding virtual reality scene to the user, immersing them in the simulated environment and providing a virtual reality experience. However, virtual reality technology has not yet been applied to model recognition. Therefore, embodiments of the present application provide a model recognition method, terminal device, and storage medium based on virtual reality.

[0038] The following will be combined with the drawings in the embodiments of this application to clearly and completely describe the technical solutions in the embodiments of this application. Obviously, the embodiments described are part of the embodiments of this application, not all of them. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of this application.

[0039] It should be understood that the terms used in this specification are only for the purpose of describing specific embodiments and are not intended to limit the present application. As used in this specification and the appended claims, the singular forms "a", "an", and "the" are intended to include the plural forms unless the context clearly indicates otherwise.

[0040] It should also be understood that the terms "first", "second", "third", "fourth", etc. (if any) in the description, claims or above-mentioned drawings of this application are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence, and cannot be understood as indicating or implying their relative importance or implicitly indicating the number of technical features indicated.

[0041] It should be further understood that the term "and / or" used in this specification and the appended claims refers to and includes any and all possible combinations of one or more of the associated listed items.

[0042] The embodiment of the present application provides a model recognition method based on virtual reality, such as Figure 1 As shown, the process may include steps S10 to S40.

[0043] S10: Obtain the three-dimensional model selected by the user.

[0044] The three-dimensional model includes multiple components, that is, the three-dimensional model is composed of multiple components. For example, suppose a three-dimensional model is composed of component A, component B, component C, component D, and component E, that is, the three-dimensional model includes five components.

[0045] In one embodiment, step S10 may include: in response to the user's model import operation, obtaining the three-dimensional model selected by the user. Exemplarily, the user can make a three-dimensional model by himself, and import the three-dimensional model through the import operation, so that the terminal device using the embodiment of the present application obtains the three-dimensional model. In other embodiments, step S10 may include: providing multiple preset three-dimensional models for the user to select, and obtaining the three-dimensional model selected by the user. Exemplarily, the preset three-dimensional model can be stored in a storage device connected to the terminal device using the embodiment of the present application, and the user selects the desired three-dimensional model, and then the terminal device loads the three-dimensional model. Exemplarily, the preset three-dimensional model can be stored in the cloud, and the cloud is connected to the terminal device using the embodiment of the present application, so that the user can access the cloud through the terminal device and select the desired three-dimensional model, and then the terminal device downloads the three-dimensional model.

[0046] S20: Generate several projection views corresponding to the three-dimensional model.

[0047] Among them, the projection view is composed of the component views of the visible components in the projection direction of the multiple components. For example, assuming that a three-dimensional model includes component A, component B, component C, component D and component E, based on this, assuming that components A, component C and component E can be seen in the projection direction of the main view, then these three components are visible components in the projection direction of the main view, from which it can be further understood that the projection view of the main view is composed of the component view of component A, the component view of component C and the component view of component E in the projection direction of the main view; similarly, assuming that components B and component D can be seen in the projection direction of the right view, then these two components are visible components in the projection direction of the right view, from which it can be further understood that the projection view of the right view is composed of the component view of component B and the component view of component D in the projection direction of the right view. In one embodiment, the plurality of projection views may include all of the six views, that is, they may include a projection view of a front view (front view), a projection view of a rear view (rear view), a projection view of a left view (left view), a projection view of a right view (right view), a projection view of a top view (top view), and a projection view of an upward view (upper view). In other embodiments, the plurality of projection views may include a portion of the six views, for example, they may include a projection view of a front view (front view), a projection view of a left view (left view), and a projection view of a top view (top view).

[0048] In some embodiments, the display properties of each component are different. For example, the display properties of a component may include color and / or style. For example, assuming that a three-dimensional model includes component A, component B, component C, component D, and component E, the display properties of these five components may exhibit different aspects in color. For example, the color of component A may be red, the color of component B may be yellow, the color of component C may be green, the color of component D may be blue, and the color of component E may be purple. Of course, the display properties of these five components may also exhibit different aspects in style. For example, the style of component A may be grid line fill, the style of component B may be diagonal line fill, and so on.

[0049] Based on this, step S20 may include: repeatedly executing the following contents until the several projection views are generated: determining the projection direction, identifying the visible components in the multiple components under the projection direction, and generating component views of the visible components under the projection direction to form a projection view.

[0050] That is, several projection views are generated respectively according to the same strategy. For example, assuming that a three-dimensional model includes component A, component B, component C, component D and component E, and the several projection views can include the projection view of the main view, then when generating the projection view of the main view, it is possible to first determine that the projection direction is the main view direction; then identify which of the multiple components are visible components in the projection direction of the main view, for example, identify that component A, component C and component E are visible components; then generate component views of these visible components in the projection direction of the main view direction, for example, generate component views using the plane projection method in the prior art. It can be understood that the component views of all visible components in the projection direction of the main view direction can constitute the projection view of the main view, that is, the component view of component A in the projection direction of the main view direction, the component view of component C in the projection direction of the main view direction and the component view of component E in the projection direction of the main view direction constitute the projection view of the main view.

[0051] In some embodiments, identifying the visible components among the multiple components in the projection direction may include: determining display attributes visible in the projection direction; and identifying the visible components among the multiple components in the projection direction based on the visible display attributes.

[0052] Specifically, in the three-dimensional model in the embodiment of the present application, the display attributes of each component are different, that is, each component corresponds to a display attribute. In this way, the display attributes that can be seen can be determined based on the projection direction, that is, the visible display attributes can be determined, and thus the visible components can be determined based on the correspondence between the display attributes and the components. For example, assume that a three-dimensional model includes components A, B, C, D, and E, and the color of component A can be red, the color of component B can be yellow, the color of component C can be green, the color of component D can be blue, and the color of component E can be purple. Assuming that the projection direction is determined to be the main viewing direction, and the display attributes visible in the main viewing direction are determined to be red, green, and purple, the visible components can be identified as components A, C, and E. Then, according to the plane projection method in the prior art, component views of these three components in the main viewing direction can be generated respectively. It can be understood that these three component views constitute the projection view of the main view.

[0053] It can be seen from this that since the three-dimensional model in the embodiment of the present application includes multiple components, and the display properties of each component are different, after determining the projection direction, the visible components can be determined according to the display properties seen, and then the component views of each visible component can be generated separately to obtain the corresponding projection view. Therefore, it can be understood that the projection view generated in this way is more accurate by determining the visible components according to the display properties and then generating the component views of each visible component. For example, in a certain related technology, the projection view is directly generated by using the plane projection method for the three-dimensional model. The projection view generated in this way is that the outermost contour lines of the view are mostly accurate, but the lines inside the contour lines are mostly wrong. Compared with this, the projection view generated in the embodiment of the present application is more accurate.

[0054] S30: Displaying the three-dimensional model on a display screen based on virtual reality technology, and displaying the plurality of projection views on the display screen.

[0055] Specifically, using virtual reality technology to display a 3D model allows users to experience a more realistic stereoscopic experience, enabling them to better learn and understand the 3D model. Simultaneously, several generated projection views are displayed to provide a comparison between the view and the model. For example, the 3D model can be displayed using virtual reality technology in the center area of ​​the display screen, while several perspective views can be displayed in the left and / or right areas of the display screen.

[0056] S40: After successful display, when any component in the three-dimensional model is selected, the selected component is highlighted, and component views corresponding to the selected component are highlighted in the plurality of projection views.

[0057] After the 3D model and several projection views are displayed on the screen, the user can begin learning about the model. To further enhance model learning, this embodiment of the present application also utilizes highlighting. Specifically, if any component is selected, that component is highlighted and also highlighted in the projection view.

[0058] For example, assume that a three-dimensional model is displayed in the center area of ​​a display screen based on virtual reality technology. The three-dimensional model may include components A, B, C, D, and E. Simultaneously, the multiple projected views displayed on the display screen may include a front view projection view (front view), a left view projection view (left view), and a top view projection view (top view). Furthermore, assume that the front view consists of component views of components A, C, and E, respectively, from the front view direction; the left view consists of component views of components B, D, and E, respectively, from the left view direction; and the top view consists of component views of components C and D, respectively, from the top view direction. Therefore, using virtual reality technology, a user can view the three-dimensional model with a realistic 3D effect by wearing 3D glasses. Of course, the user can also view the three projected views. Furthermore, the user can use a mouse, interactive pen, interactive handle, or other methods to move and rotate the three-dimensional model. Based on this, after successful display, the user can begin to learn about the model. During the model learning process, if the user selects a component, the component is highlighted, and the projected view is also highlighted accordingly, for example, by being highlighted. For example, if component A is selected, component A is highlighted, and the component view of component A is highlighted in the main view; if component C is selected, component C is highlighted, and the component view of component C is highlighted in the main view, and the component view of component C is highlighted in the top view.

[0059] As can be seen from this, on the one hand, the three-dimensional model in the embodiment of the present application includes multiple components, and the display properties of each component are different, so the projection view generated by the method in the embodiment of the present application is more accurate; on the other hand, displaying the three-dimensional model based on virtual reality technology can allow users to experience a more realistic 3D effect, and during the display process, if a component is selected, the component is highlighted and the corresponding highlight is performed in the projection view, forming a correspondence, which is more friendly to model cognition. Therefore, the embodiment of the present application can intuitively display the three-dimensional model and projection view with an associated relationship, which can improve the learning effect of model cognition.

[0060] In some embodiments, after step S20, the model recognition method based on virtual reality may further include: associating the component view in the projection view with the component in the three-dimensional model to establish an association relationship. For example, assuming that a certain three-dimensional model can include component A, component B, component C, component D and component E, and the main view is composed of the component views of component A, component C and component E respectively in the main viewing direction, the left view is composed of the component views of component B, component D and component E respectively in the left viewing direction, and the top view is composed of the component views of component C and component D respectively in the top viewing direction. Then, component A in the three-dimensional model can be associated with the component view corresponding to component A in the main view, and so on, until component E in the three-dimensional model is associated with the component view corresponding to component E in the main view and the component view corresponding to component E in the left view, thereby establishing an association relationship between the components in the three-dimensional model and the corresponding component views in the projection view.

[0061] Based on this, step S40 may include steps S410 to S420.

[0062] S410: When any component in the three-dimensional model is selected, highlight the selected component.

[0063] S420: According to the association relationship, highlight the component views associated with the selected component in the plurality of projection views.

[0064] Among them, highlighting includes highlighting and / or displaying with the display attributes of the selected component. For example, assuming a red component is selected, when highlighting in the 3D model, due to the different display attributes of the components in the 3D model (for example, this component is displayed red, that component is displayed blue), the highlighting method can be to highlight this component. For another example, assuming a red component is selected, when highlighting in the projection view, if the interior of the component view in the projection view is unfilled, the highlighting method can be to fill the component view corresponding to this component with red and highlight it.

[0065] Therefore, if any component in the 3D model is selected, for example, by a user aiming the infrared light emitted by the interactive pen at a component, the component is first highlighted, for example, by being displayed in a highlighted manner. Then, based on the previously established associations, the associated component views are identified in the projected view and highlighted, for example, by filling the interior with the display color of the selected component and by highlighting it.

[0066] In some embodiments, as Figure 2 As shown, after step S40, the model recognition method based on virtual reality may further include step S50.

[0067] S50. If it is detected that any one of the projection views is selected, the three-dimensional model is centered, and the side of the three-dimensional model corresponding to the projection direction of the selected projection view is displayed positively, and the remaining projection views of the several projection views are hidden.

[0068] For example, assuming that a projection view in the main viewing direction (main view), a projection view in the left viewing direction (left view), and a projection view in the top viewing direction (top view) are displayed on the display screen, the user can select one of the projection views, for example, by checking a box. This example uses the main view as an example for explanation. After the main view is selected, the 3D model can be centered. This is because the 3D model may be moved and rotated to a more peripheral position by the user using an interactive pen, etc., so it can be centered to facilitate cognitive learning. In addition, the side of the 3D model corresponding to the main viewing direction is displayed frontally, that is, the side corresponding to the main view is displayed frontally to the user. The front here refers to the user. That is, no matter how the user's head moves within the normal range, based on virtual reality technology, the side of the 3D model corresponding to the main viewing direction will be displayed frontally to the user. At the same time, in order to eliminate interference from other views, the left view and top view other than the main view can also be hidden. Of course, if the user wants to exit this mode, they can deselect the main view, for example, by unchecking it, and restore normal display. As can be seen from this, the embodiments of the present application can further improve the learning effect of model cognition.

[0069] The embodiment of the present application also provides a terminal device, such as Figure 3 As shown, the terminal device includes a processor and a memory. The memory is used to store a computer program; the processor is used to execute the computer program and implement any virtual reality-based model recognition method provided in the embodiments of the present application when executing the computer program.

[0070] It should be understood that the processor may be a central processing unit (CPU), other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or any conventional processor, etc.

[0071] The embodiments of the present application also provide a computer-readable storage medium, which stores a computer program. When the computer program is executed by a processor, the processor implements any virtual reality-based model recognition method provided by the embodiments of the present invention.

[0072] It will be understood by those skilled in the art that all or some of the steps, systems, and functional modules / units in the methods disclosed above may be implemented as software, firmware, hardware, and appropriate combinations thereof. In a hardware implementation, the division between the functional modules / units mentioned in the above description does not necessarily correspond to the division of physical components; for example, a physical component may have multiple functions, or a function or step may be performed by several physical components in cooperation. Some or all physical components may be implemented as software executed by a processor, such as a central processing unit, a digital signal processor, or a microprocessor, or may be implemented as hardware, or may be implemented as an integrated circuit, such as an application-specific integrated circuit. Such software may be distributed on a computer-readable storage medium, which may include a computer-readable storage medium (or a non-transitory medium) and a communication medium (or a temporary medium).

[0073] As is well known to those skilled in the art, the term computer-readable storage media includes volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storing information (such as computer-readable instructions, data structures, program modules or other data). Computer-readable storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disks (DVD) or other optical disk storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium that can be used to store the desired information and can be accessed by a computer. Furthermore, as is well known to those skilled in the art, communication media typically contains computer-readable instructions, data structures, program modules or other data in a modulated data signal such as a carrier wave or other transport mechanism, and may include any information delivery media.

[0074] Exemplarily, the computer-readable storage medium may be an internal storage unit of the terminal device described in the aforementioned embodiment, such as a hard disk or memory of the terminal device. The computer-readable storage medium may also be an external storage device of the terminal device, such as a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) card, a flash memory card, etc., equipped on the terminal device.

[0075] The above description is merely a specific embodiment of the present invention, but the scope of protection of the present invention is not limited thereto. Any person skilled in the art can easily conceive of various equivalent modifications or substitutions within the technical scope disclosed in the present invention, and such modifications or substitutions are intended to be within the scope of protection of the present invention. Therefore, the scope of protection of the present invention shall be subject to the scope of protection of the claims.

Claims

1. A model recognition method based on virtual reality, characterized in that: include: Acquire a three-dimensional model selected by a user; wherein the three-dimensional model includes a plurality of components; Generating a plurality of projection views corresponding to the three-dimensional model; wherein the projection views are composed of component views of visible components in the projection directions of the plurality of components; Displaying the three-dimensional model on a display screen based on virtual reality technology, and displaying the plurality of projection views on the display screen; After successful display, when any component in the three-dimensional model is selected, the selected component is highlighted, and the component view corresponding to the selected component is highlighted in the plurality of projection views.

2. The model recognition method based on virtual reality according to claim 1, characterized in that: The obtaining of the three-dimensional model selected by the user includes: In response to a user's model import operation, obtaining a three-dimensional model selected by the user; or providing multiple preset three-dimensional models for the user to select, and obtaining the three-dimensional model selected by the user; And / or, the plurality of projection views include a part or all of the six views.

3. The model recognition method based on virtual reality according to claim 1, characterized in that: The display properties of each of the components are different; Generating a plurality of projection views corresponding to the three-dimensional model includes: Repeat the following steps until the plurality of projection views are generated: determine a projection direction, identify visible components in the plurality of components in the projection direction, and generate component views of the visible components in the projection direction to form projection views.

4. The model recognition method based on virtual reality according to claim 3 is characterized in that: The display properties of the component include color and / or style.

5. The model recognition method based on virtual reality according to claim 3 or 4, characterized in that: The identifying a visible component in the projection direction among the plurality of components includes: determining display attributes visible in the projection direction; According to the visible display attribute, a visible component in the projection direction among the multiple components is identified.

6. The model recognition method based on virtual reality according to claim 1, characterized in that: After generating a plurality of projection views corresponding to the three-dimensional model, the method further includes: Associating the component view in the projection view with the component in the three-dimensional model to suggest an association relationship; When any component in the three-dimensional model is selected, the selected component is highlighted, and component views corresponding to the selected component are highlighted in the plurality of projection views, including: When any component in the three-dimensional model is selected, highlighting the selected component; According to the association relationship, the component views associated with the selected component in the plurality of projection views are highlighted.

7. The model recognition method based on virtual reality according to claim 6, characterized in that: The highlighting process includes displaying and / or highlighting the selected component using the display attributes of the selected component.

8. The virtual reality-based model recognition method according to any one of claims 1-4, 6-7, characterized in that: After the display is successfully completed, the method further includes: If it is detected that any one of the several projection views is selected, the three-dimensional model is centered and the side of the three-dimensional model corresponding to the projection direction of the selected projection view is displayed positively, and the remaining projection views of the several projection views are hidden.

9. A terminal device, characterized in that: including processor and memory; The memory is used to store computer programs; The processor is configured to execute the computer program and implement the virtual reality-based model recognition method according to any one of claims 1 to 8 when executing the computer program.

10. A computer-readable storage medium, characterized in that The computer-readable storage medium stores a computer program, which, when executed by a processor, enables the processor to implement the virtual reality-based model recognition method according to any one of claims 1 to 8.

Images