A 3D animation resource calling and generating system for teaching

Abstract

The present invention relates to a three-dimensional animation resource calling and generating system for teaching, comprising a scanning module for scanning a two-dimensional image of a traditional teaching material, an extraction module for extracting features from a scanned image generated after scanning the two-dimensional image of the traditional teaching material, a recognition module for recognizing a feature image extracted by the extraction module, a three-dimensional conversion module for converting the feature image recognized by the recognition module into a three-dimensional image, a storage module storing audio materials, a three-dimensional animation unit production module for making three-dimensional animation units, a calling and running module for calling the three-dimensional animation unit generated by the three-dimensional animation unit production module and running it according to a designed path and a designed rate, a playing module for playing three-dimensional animation, and a three-dimensional animation synthesis module for running and synthesizing a plurality of three-dimensional animation units according to a specified path and a specified rate. The system has a high degree of intelligence, high recognition efficiency, and accurate playback, which helps to improve the teaching effect.

Description

Technical Field

[0001] The invention relates to a three-dimensional animation resource calling and generating system for teaching, belonging to the technical field of intelligent teaching. Background Art

[0002] At present, the theory and practice are separated in the teaching of planning and design in process disciplines. Two-dimensional drawings are mostly used as teaching aids. Thinking about three-dimensional space problems on two-dimensional drawings requires strong drawing recognition and spatial thinking abilities, which is very difficult for students who have just come into contact with engineering planning and design. However, the existing engineering design auxiliary software tools have computer drawing models, but most of them are the expression of two-dimensional drawing results, that is, plane first, then modeling, from plane to three-dimensional model. Students' learning is not only limited by drawing ability, but also the construction time of plane design and three-dimensional model is not synchronized, and the three-dimensional space model lacks overall coherence and experience, which has little influence on students' spatial analysis in process design and little auxiliary effect on the design learning process. For physical model tools, it is also plane first and then three-dimensional. The finished physical model is fixed, which makes it impossible to disassemble it at will, and the production cost is high. Students can only watch it, but cannot transform or reorganize it by hand. The scope of use is small, and the teaching display effect is limited. It cannot achieve the teaching effect of combining hands-on and brain-based teaching, and cannot meet the needs of garden planning and design teaching.

[0003] The defects in traditional industrial training and teaching models are becoming increasingly obvious. In actual training and teaching, not only are there limitations in time and space, but the boring teaching explanations will also reduce students' enthusiasm for learning. In addition, in order to increase student participation, real disassembly and assembly learning will be carried out, so incorrect operations will bring potential safety hazards and may also cause damage to some products with higher precision requirements.

[0004] Therefore, it is necessary to develop a design method based on digital assembly, changing from a computer-centered design method to a people-centered design method, which plays a guiding role in the teaching and training process. Three-dimensional animation resources can be used to assist teaching and help practitioners quickly master core technologies. Summary of the invention

[0005] In view of the shortcomings of the prior art, the present invention provides a teaching 3D animation resource calling and generating system, and the specific technical scheme is as follows:

[0006] A teaching 3D animation resource calling and generating system, comprising:

[0007] A scanning module for scanning the two-dimensional image of the traditional teaching material, an extraction module for extracting features from the scanned image generated after scanning the two-dimensional image of the traditional teaching material, a recognition module for recognizing the feature image extracted by the extraction module, a three-dimensional conversion module for converting the feature image recognized by the recognition module into a three-dimensional image, a storage module for storing audio materials, a three-dimensional animation unit production module for producing three-dimensional animation units, a calling and running module for calling the three-dimensional animation unit generated by the three-dimensional animation unit production module and running it according to the designed path and designed speed, a playing module for playing three-dimensional animation, and a three-dimensional animation synthesis module for running and synthesizing several three-dimensional animation units according to a specified path and specified speed.

[0008] As an improvement of the above technical solution, a scanning module is used to scan the two-dimensional image of the traditional teaching material to obtain a scanned picture, an extraction module is used to extract features from the scanned picture generated after scanning to obtain a feature picture, a recognition module is used to recognize the feature picture extracted by the extraction module and the feature picture recognized by the recognition module is converted into a three-dimensional image through a three-dimensional conversion module, the storage module stores audio materials, and the three-dimensional image is stored in the storage module; a three-dimensional animation unit production module is used to select the audio materials and three-dimensional images stored in the storage module and make them into three-dimensional animation units, the three-dimensional animation unit generated by the three-dimensional animation unit production module is called by calling the running module and runs according to the designed path and designed rate to obtain a three-dimensional design animation, the three-dimensional design animation is played through the playing module during the running process, the user checks the three-dimensional design animation, and after the check is passed, the corresponding design path is set to the specified path and the corresponding design rate is set to the specified rate; a three-dimensional animation synthesis module is used to run a number of three-dimensional animation units according to the specified path and specified rate and synthesize the three-dimensional animation teaching materials.

[0009] As an improvement of the above technical solution, it also includes a matching module, the storage module also stores other pre-made three-dimensional animation teaching materials, uses the recognition module to recognize the feature image extracted by the extraction module and matches the feature image recognized by the recognition module with other three-dimensional animation teaching materials, and uses the matching module to perform calculations to obtain matching results; when the matching result meets the set value, the corresponding other three-dimensional animation teaching materials are played using the playback module.

[0010] As an improvement of the above technical solution, the matching module includes a three-dimensional animation reversal unit for reversing other three-dimensional animation teaching materials into two-dimensional animation teaching materials, a two-dimensional video decomposition unit for decomposing two-dimensional animation teaching materials into frame images, a correction unit for correcting the feature image recognized by the recognition module into a projection view, a matching operation unit for performing matching operations, and a similarity screening unit.

[0011] The other three-dimensional animation teaching materials are reversed into two-dimensional animation teaching materials by a three-dimensional animation reversal unit, and the two-dimensional animation teaching materials are decomposed by a two-dimensional video decomposition unit and marked into corresponding frame image sets according to the projection rules of six views; the feature image recognized by the recognition module is corrected into a projection view by a correction unit, and the basic view type of the projection view is determined by the projection algorithm in the matching operation unit, and the frame image set corresponding to the basic view is selected according to the determined basic view type of the projection view and marked as a preliminary screening frame image set; the similarity algorithm in the similarity screening unit is used to calculate the similarity between two adjacent frame images in the preliminary screening frame image set and mark the corresponding frame images, and the frame images with a similarity less than a first set value are grouped into a verification frame image set, and the frame images with a similarity greater than or equal to the first set value are grouped into a fine screening frame image set;

[0012] The similarity algorithm in the matching operation unit is used to calculate the similarity between the projection view and the frame image of each frame in the fine-screening frame image set. When the similarity between the projection view and the corresponding frame image in the fine-screening frame image set is greater than or equal to the second set value, the matching result is determined to meet the set value.

[0013] As an improvement of the above technical solution, when the similarity between the projection view and the corresponding frame image in the fine-screening frame image set is less than a second set value, the frame image in the fine-screening frame image set with the greatest similarity to the projection view is selected as the first similar frame image, and the similarity algorithm in the matching operation unit is used to calculate the similarity between the first similar frame image and each frame in the verification frame image set. When the similarity between the first similar frame image and the corresponding frame image in the verification frame image set is greater than or equal to a third set value, it is determined that the matching result meets the set value.

[0014] As an improvement of the above technical solution, the second set value is equal to the third set value multiplied by a correction coefficient.

[0015] As an improvement of the above technical solution, the basic view types include front view, top view, left view, right view, bottom view and rear view.

[0016] Beneficial effects of the present invention:

[0017] The teaching three-dimensional animation resource calling and generating system has a high degree of intelligence, high recognition efficiency, and accurate playback. The system collects two-dimensional images on traditional teaching materials, converts them into three-dimensional animation teaching materials and plays them, so as to realize the three-dimensionalization and animation of two-dimensional images, which can better stimulate students' interest and deepen students' impressions through vivid animations to improve teaching effects. The audio materials stored in the storage module can be recorded in advance, especially the user's own teaching voice, so as to achieve the vivid effect of personal explanation, realize intelligent and entertaining teaching, and help improve teaching effects. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] Figure 1 This is a flow chart of the system for calling and generating teaching 3D animation resources described in Example 1. DETAILED DESCRIPTION

[0019] In order to make the purpose, technical solution and advantages of the present invention more clearly understood, the present invention is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not intended to limit the present invention.

[0020] Example 1

[0021] The teaching 3D animation resource calling and generating system comprises:

[0022] A scanning module for scanning the two-dimensional image of the traditional teaching material, an extraction module for extracting features from the scanned image generated after scanning the two-dimensional image of the traditional teaching material, a recognition module for recognizing the feature image extracted by the extraction module, a three-dimensional conversion module for converting the feature image recognized by the recognition module into a three-dimensional image, a storage module for storing audio materials, a three-dimensional animation unit production module for producing three-dimensional animation units, a calling and running module for calling the three-dimensional animation unit generated by the three-dimensional animation unit production module and running it according to the designed path and designed speed, a playing module for playing three-dimensional animation, and a three-dimensional animation synthesis module for running and synthesizing several three-dimensional animation units according to a specified path and specified speed.

[0023] like Figure 1 As shown, the workflow of the teaching 3D animation resource calling and generating system is as follows:

[0024] The scanning module is used to scan the two-dimensional image of the traditional teaching material to obtain a scanned picture, the extraction module is used to extract features from the scanned picture generated after scanning to obtain a feature picture, the recognition module is used to recognize the feature picture extracted by the extraction module and the feature picture recognized by the recognition module is converted into a three-dimensional image through a three-dimensional conversion module, the storage module stores audio materials, and the three-dimensional image is stored in the storage module; the three-dimensional animation unit production module is used to select the audio materials and three-dimensional images stored in the storage module and make them into three-dimensional animation units, the three-dimensional animation unit generated by the three-dimensional animation unit production module is called by calling the running module and runs according to the design path and design rate to obtain a three-dimensional design animation, the three-dimensional design animation is played through the playing module during the running process, the user checks the three-dimensional design animation, and after the check is passed, the corresponding design path is set to the specified path and the corresponding design rate is set to the specified rate; the three-dimensional animation synthesis module runs a number of three-dimensional animation units according to the specified path and specified rate and synthesizes the three-dimensional animation teaching materials.

[0025] Application scenario: The structural diagram of a part in a traditional textbook only needs to be scanned by the scanning module to obtain the three-dimensional structural diagram of the part (corresponding to the three-dimensional image). Then, during the debugging process, the three-dimensional structural diagram of the part continuously adjusts the design path, design rate, and audio material, and plays the demonstration through the playback module. When the demonstration results meet the expected requirements, the corresponding design path, design rate, and audio material will be determined, and the three-dimensional animation synthesis module will be used to run several three-dimensional animation units according to the specified path and specified rate and synthesize the three-dimensional animation teaching material.

[0026] In the above process, the system has a high degree of intelligence, high recognition efficiency, and accurate playback. The system collects two-dimensional images on traditional textbooks, converts them into three-dimensional animation teaching materials and plays them, realizing the three-dimensionalization and animation of two-dimensional images, which can better stimulate students' interest, deepen students' impressions through vivid animations, and help improve teaching effects. The audio materials stored in the storage module can be recorded in advance, especially the user's own teaching voice, so as to achieve the vivid effect of personal explanation, realize intelligent and entertaining teaching, and help improve teaching effects.

[0027] Example 2

[0028] Based on Example 1, the teaching 3D animation resource call generation system also includes a matching module, and the storage module also stores other pre-made 3D animation teaching materials. The recognition module is used to recognize the feature image extracted by the extraction module and the feature image recognized by the recognition module is matched with other 3D animation teaching materials. The matching module is used to perform calculations to obtain matching results; when the matching result meets the set value, the corresponding other 3D animation teaching materials are played using the playback module.

[0029] The use of other 3D animation teaching materials prepared in advance can help reduce the burden on the system, thereby helping to improve the system's computing rate. If there are a large number of other 3D animation teaching materials, the system burden will be small in the later stage; the only drawback is that a lot of preparation work needs to be done in advance, and the 2D images of traditional teaching materials need to be converted into corresponding other 3D animation teaching materials in advance.

[0030] The working principle of the matching module is as follows:

[0031] The matching module includes a three-dimensional animation reversal unit for reversing other three-dimensional animation teaching materials into two-dimensional animation teaching materials, a two-dimensional video decomposition unit for decomposing two-dimensional animation teaching materials into frame images, a correction unit for correcting the feature image recognized by the recognition module into a projection view, a matching operation unit for performing matching operations, and a similarity screening unit.

[0032] The other three-dimensional animation teaching materials are reversed into two-dimensional animation teaching materials by a three-dimensional animation reversal unit, and the two-dimensional animation teaching materials are decomposed by a two-dimensional video decomposition unit and marked into corresponding frame image sets according to the projection rules of six views; the feature image recognized by the recognition module is corrected into a projection view by a correction unit, and the basic view type of the projection view is determined by the projection algorithm in the matching operation unit, and the frame image set corresponding to the basic view is selected according to the determined basic view type of the projection view and marked as a preliminary screening frame image set; the similarity algorithm in the similarity screening unit is used to calculate the similarity between two adjacent frame images in the preliminary screening frame image set and mark the corresponding frame images, and the frame images with a similarity less than a first set value are grouped into a proofreading frame image set, and the frame images with a similarity greater than or equal to the first set value are grouped into a fine screening frame image set.

[0033] The similarity algorithm in the matching operation unit is used to calculate the similarity between the projection view and the frame image of each frame in the fine-screening frame image set. When the similarity between the projection view and the corresponding frame image in the fine-screening frame image set is greater than or equal to the second set value, the matching result is determined to meet the set value.

[0034] Among them, the basic view types include front view, top view, left view, right view, bottom view and rear view.

[0035] In the above process, if the similarity algorithm in the matching operation unit is used to calculate the projection view and each frame image in the frame image set, the workload is very huge, which is very likely to affect the operation speed and restrict the improvement of the fluency of the system. However, by adopting the operation method of this embodiment, at least the amount of operation can be reduced by more than 2 / 3, and the operation effect can be significantly improved.

[0036] If only the case where the similarity between the projection view and the corresponding frame image in the fine-screening frame image set is greater than or equal to the second set value is calculated, omissions are likely to occur. For example, if the similarity between the projection view and the corresponding frame image in the fine-screening frame image set is 0.94, and the second set value is 0.95, in this case, if there is no relief measure, omissions are likely to occur. Since 0.94 and 0.95 are very close, if sampling is omitted, it may be missed.

[0037] Further, when the similarity between the projection view and the corresponding frame image in the fine-screening frame image set is less than a second set value, the frame image in the fine-screening frame image set with the greatest similarity to the projection view is selected as the first similar frame image, and the similarity algorithm in the matching operation unit is used to calculate the similarity between the first similar frame image and the frame image of each frame in the verification frame image set. When the similarity between the first similar frame image and the corresponding frame image in the verification frame image set is greater than or equal to a third set value, it is determined that the matching result meets the set value.

[0038] The second setting value is equal to the third setting value multiplied by a correction coefficient.

[0039] If the third set value is 0.93, it is equivalent to resampling from the original set with a smaller similarity, and it is possible to sample a frame image with a similarity of 0.94; then the sample can be taken from the calibration frame image set to make a judgment, thereby avoiding the occurrence of missed detection. Therefore, the accuracy of the calculation can be significantly improved.

[0040] In the above embodiment, the teaching three-dimensional animation resource calling and generating system has a high degree of intelligence, high recognition efficiency, and accurate playback. The system collects two-dimensional images on traditional teaching materials, converts them into three-dimensional animation teaching materials and plays them, realizes the three-dimensionalization and animation of two-dimensional images, can better stimulate students' interest, deepen students' impressions through vivid animations, and improve teaching effects. The audio materials stored in the storage module can be recorded in advance, especially the user's own teaching voice, so as to achieve the vivid effect of personal explanation, realize intelligent and entertaining teaching, and help improve teaching effects.

[0041] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present invention should be included in the protection scope of the present invention.

Claims

1. A teaching 3D animation resource calling and generating system, characterized in that include: A scanning module for scanning the two-dimensional image of the traditional teaching material, an extraction module for extracting features from the scanned image generated after scanning the two-dimensional image of the traditional teaching material, a recognition module for recognizing the feature image extracted by the extraction module, a three-dimensional conversion module for converting the feature image recognized by the recognition module into a three-dimensional image, a storage module storing audio materials, a three-dimensional animation unit production module for producing three-dimensional animation units, a calling and running module for calling the three-dimensional animation unit generated by the three-dimensional animation unit production module and running it according to the designed path and designed speed, a playing module for playing three-dimensional animation, and a three-dimensional animation synthesis module for running and synthesizing a plurality of three-dimensional animation units according to a specified path and specified speed; The scanning module is used to scan the two-dimensional image of the traditional teaching material to obtain a scanned image, the extraction module is used to extract features from the scanned image generated after scanning to obtain a feature image, the recognition module is used to recognize the feature image extracted by the extraction module and the feature image recognized by the recognition module is converted into a three-dimensional image through a three-dimensional conversion module, the storage module stores audio materials, and the three-dimensional image is stored in the storage module; the three-dimensional animation unit production module is used to select the audio materials and three-dimensional images stored in the storage module and make them into three-dimensional animation units, the three-dimensional animation unit generated by the three-dimensional animation unit production module is called by calling the running module and runs according to the design path and design rate to obtain a three-dimensional design animation, the three-dimensional design animation is played through the playing module during the running process, the user checks the three-dimensional design animation, and after the check is passed, the corresponding design path is set to the specified path and the corresponding design rate is set to the specified rate; the three-dimensional animation synthesis module runs a number of three-dimensional animation units according to the specified path and specified rate and synthesizes the three-dimensional animation teaching materials; It also includes a matching module, the storage module also stores other pre-made three-dimensional animation teaching materials, uses the recognition module to recognize the feature image extracted by the extraction module and matches the feature image recognized by the recognition module with other three-dimensional animation teaching materials, and uses the matching module to perform calculations to obtain matching results; when the matching result meets the set value, the corresponding other three-dimensional animation teaching materials are played by the playing module; The matching module includes a three-dimensional animation reversal unit for reversing other three-dimensional animation teaching materials into two-dimensional animation teaching materials, a two-dimensional video decomposition unit for decomposing two-dimensional animation teaching materials into frame images, a correction unit for correcting feature images recognized by the recognition module into projection views, a matching operation unit for performing matching operations, and a similarity screening unit. The other three-dimensional animation teaching materials are reversed into two-dimensional animation teaching materials by the three-dimensional animation reversal unit, and the two-dimensional animation teaching materials are decomposed by the two-dimensional video decomposition unit and marked into corresponding frame image sets according to the projection rules of six views; the feature images recognized by the recognition module are corrected into projection views by the correction unit, and the basic view type of the projection view is determined by the projection algorithm in the matching operation unit. According to the determined basic view type of the projection view, a frame image set corresponding to the basic view is selected and marked as a preliminary screening frame image set; The similarity algorithm in the similarity screening unit is used to calculate the similarity between two adjacent frame images in the preliminary screening frame image set and mark the corresponding frame images, and the frame images with similarity less than a first set value are grouped into a verification frame image set, and the frame images with similarity greater than or equal to the first set value are grouped into a fine screening frame image set; The similarity algorithm in the matching operation unit is used to calculate the similarity between the projection view and the frame image of each frame in the fine-screening frame image set. When the similarity between the projection view and the corresponding frame image in the fine-screening frame image set is greater than or equal to the second set value, the matching result is determined to meet the set value.

2. A teaching 3D animation resource calling and generating system according to claim 1, characterized in that: When the similarity between the projection view and the corresponding frame image in the fine-screening frame image set is less than the second set value, the frame image in the fine-screening frame image set with the greatest similarity to the projection view is selected as the first similar frame image, and the similarity algorithm in the matching operation unit is used to calculate the similarity between the first similar frame image and the frame image of each frame in the verification frame image set. When the similarity between the first similar frame image and the corresponding frame image in the verification frame image set is greater than or equal to the third set value, it is determined that the matching result meets the set value.

3. The teaching 3D animation resource calling and generating system according to claim 2, characterized in that: The second setting value is equal to the third setting value multiplied by a correction coefficient.

4. The teaching 3D animation resource calling and generating system according to claim 1, characterized in that: The basic view types include front view, top view, left view, right view, bottom view and rear view.

Images