Electronic specimen teaching system

Abstract

The invention relates to the technical field of electronic teaching, in particular to an electronic specimen teaching system, which is characterized in that a 3D scanning module scans a natural specimen through a 3D scanning function of scanning equipment, and establishes a three-dimensional model of the natural specimen according to scanning data; the 3D printing module exports the three-dimensional model in a preset format and sends an exported file to a 3D printer according to a user printing instruction; the holographic image module is connected with holographic image equipment, and sends the three-dimensional model to the holographic image equipment, so that the holographic image equipment displays the three-dimensional model; and the AR display module renders the three-dimensional model into a real scene picture according to the operation of the user on the intelligent equipment. According to the technical scheme, the electronic specimen is established by scanning the natural specimen, the electronic specimen is not prone to damage, 3D printing, holographic images and AR display are fused, the specimen model can be visually presented in a more detailed mode, and meanwhile the interest of a learner in active learning is stimulated.

Description

Technical Field

[0001] The present invention relates to the technical field of electronic teaching, and particularly relates to an electronic specimen teaching system. Background Art

[0002] Currently, the tools and methods in the field of nature education mainly rely on traditional specimen collection and display methods, such as physical animal and plant specimens, planar graphic materials or static models. Such methods have significant limitations:

[0003] Physical property defects: Physical specimens are easily damaged by environmental factors (such as humidity, pests), with high preservation costs and difficult to maintain integrity for a long time; Specimens of some rare or endangered species are restricted in acquisition and cannot be widely used in educational scenarios.

[0004] Single information presentation: Traditional display means are mainly two-dimensional planes (such as pictures, texts), and it is difficult to intuitively present the spatial relationships of biological structures (such as internal organs of insects, root distributions of plants), resulting in learners' understanding of complex biological characteristics remaining on the surface.

[0005] Lack of interactivity and interestingness: Lack of a dynamic interaction mechanism, learners can only passively observe and are difficult to participate in the knowledge exploration process. Especially for children, the traditional mode is difficult to stimulate their active learning interest, and the learning effect is restricted by the limitations of one-way indoctrination. Summary of the Invention

[0006] In view of this, the purpose of the present invention is to provide an electronic specimen teaching system to solve the problems of easy damage of physical specimens, single information presentation, and lack of interactivity and interestingness in the prior art.

[0007] According to the first aspect of the embodiments of the present invention, an electronic specimen teaching system is provided, including:

[0008] A 3D scanning module, a 3D printing module, a holographic imaging module, and an AR display module;

[0009] The 3D scanning module is used to scan a natural specimen through the 3D scanning function of a scanning device, and establish a three-dimensional model of the natural specimen according to the scanning data;

[0010] The 3D printing module is used to export the three-dimensional model in a preset format, and send the exported file to a 3D printer according to a user printing instruction;

[0011] The holographic imaging module is used to connect to a holographic imaging device, and send the three-dimensional model to the holographic imaging device, so that the holographic imaging device displays the three-dimensional model;

[0012] The AR display module is used to render the three-dimensional model into the real scene picture according to the user's operations on the intelligent device.

[0013] Preferably, the 3D scanning module is further used to call an AI algorithm to optimize the three-dimensional model.

[0014] Preferably, the 3D printing module is further used to display a pre-stored printing guide tutorial according to the user's printing instruction.

[0015] Preferably, the holographic imaging module is further used to obtain the user's control instruction and adjust the form of the three-dimensional model displayed by the holographic imaging device according to the control instruction; the control instruction includes: a gesture interaction instruction, and / or, a voice control instruction.

[0016] Preferably, the electronic specimen teaching system further includes:

[0017] A data storage module, which is used to store the scanning data, three-dimensional model, holographic image, pictures and text voice descriptions corresponding to the natural specimen, and is also used to store user data.

[0018] Preferably, the data storage module is further used to upload the stored data to the cloud for cloud storage; it is also used to synchronize the data stored in the cloud to the current device according to the user data when the user starts the electronic specimen teaching system through different devices.

[0019] Preferably, the electronic specimen teaching system further includes: an interactive learning module, which is used to obtain the user's sharing instruction and share the three-dimensional model with other users or communities according to the sharing instruction.

[0020] Preferably, the electronic specimen teaching system further includes:

[0021] An account management module, which is used to manage user data; it is also used to bind the parent account and the student account according to the obtained user instruction.

[0022] The technical solution provided by the embodiments of the present invention may include the following beneficial effects:

[0023] It can be understood that the technical solution shown in the present invention integrates 3D scanning, 3D printing, holographic imaging and AR augmented reality technologies to construct an electronic specimen teaching system. By generating a high-precision three-dimensional model through 3D scanning, users can independently collect natural specimens and convert them into digital specimens, realizing the creative participation feeling of "from reality to virtual"; the holographic imaging technology enables users to stereoscopically disassemble the specimen structure, breaking through the spatial limitation of traditional flat display. The AR augmented reality technology superimposes the virtual specimen on the real environment, stimulating the active learning interest of learners and turning passive learning into active learning.

[0024] It should be understood that the above general description and the following detailed description are merely exemplary and explanatory, and do not limit the present invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0025] The accompanying drawings herein are incorporated into and constitute a part of this specification, showing embodiments consistent with the present invention, and are used together with the specification to explain the principles of the present invention.

[0026] Figure 1 is a schematic block diagram of an electronic specimen teaching system shown according to an exemplary embodiment;

[0027] Figure 2 is a schematic flow diagram of a 3D scanning module shown according to an exemplary embodiment;

[0028] Figure 3 is a schematic flow diagram of the use of a 3D printing module shown according to an exemplary embodiment;

[0029] Figure 4 is an effect diagram of the use of a holographic imaging module shown according to an exemplary embodiment. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0030] Exemplary embodiments will be described in detail herein, and examples thereof are shown in the accompanying drawings. When the following description refers to the accompanying drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present invention. On the contrary, they are merely examples of devices and methods consistent with some aspects of the present invention as detailed in the appended claims.

[0031] In one embodiment, Figure 1 is a schematic block diagram of an electronic specimen teaching system shown according to an exemplary embodiment. Refer to Figure 1 , a kind of electronic specimen teaching system is provided, including:

[0032] a 3D scanning module, a 3D printing module, a holographic imaging module and an AR display module;

[0033] The 3D scanning module is configured to scan a natural specimen through the 3D scanning function of a scanning device, and establish a three-dimensional model of the natural specimen according to the scanning data;

[0034] The 3D printing module is configured to export the three-dimensional model in a preset format, and send the exported file to a 3D printer according to a user printing instruction;

[0035] The holographic image module is used to connect to a holographic image device and send the three-dimensional model to the holographic image device, so that the holographic image device can display the three-dimensional model;

[0036] The AR display module is used to render the three-dimensional model into a real scene picture according to the user's operations on the smart device.

[0037] It can be understood that the technical solution shown in this embodiment integrates 3D scanning, 3D printing, holographic imaging, and AR augmented reality technologies to construct an electronic specimen teaching system. By generating a high-precision three-dimensional model through 3D scanning, users can independently collect natural specimens and convert them into digital specimens, realizing the creative participation sense of "from reality to virtual"; the holographic imaging technology enables users to stereoscopically disassemble the specimen structure, breaking through the spatial limitations of traditional planar displays. The AR augmented reality technology superimposes virtual specimens onto the real environment, stimulating the active learning interest of learners and turning passive learning into active learning.

[0038] In a preferred embodiment, the 3D scanning module is further used to call an AI algorithm to optimize the three-dimensional model.

[0039] For the implementation process of the 3D scanning module, see Figure 2 , first, the user starts the 3D scanning module of the electronic specimen teaching system on their own smart device. This module integrates 3D scanning development tools such as Google ARCore (Android side) or Apple ARKit (iOS side), and can call hardware resources such as the device camera and depth sensor to achieve environmental perception and point cloud data acquisition.

[0040] After starting the 3D scanning module, device detection is performed. It is necessary to detect whether the smart device currently used by the user supports 3D scanning. If the smart device supports 3D scanning, the subsequent scanning process will continue; otherwise, a prompt indicating that 3D scanning is not supported will be generated.

[0041] After the device detection is passed, the user uses the smart device to scan the natural specimen.

[0042] Preferably, during the scanning, a scanning guide can be generated, and the user is prompted by an animation to move the device around the specimen to ensure complete scanning coverage (such as prompting "Rotate the specimen clockwise" "Adjust the shooting distance"). The scanning progress bar and the point cloud density heat map are displayed in real time. When data is missing in a key area (such as the top of the specimen), a reminder for supplementary scanning is automatically triggered.

[0043] After the scanning is completed, scanning data is generated. It is necessary to process the data to generate a three-dimensional model, and then call an AI algorithm to optimize the three-dimensional model.

[0044] The scanned data can be processed by computer vision algorithms to automatically repair holes in the 3D model and optimize the surface smoothness. At the same time, lightweight rendering technology can be adopted to compress the number of model polygons, ensuring smooth operation on mobile devices while retaining key details such as insect textures and leaf veins. Users can preview the model and perform "local rescan", such as repairing blurred wing edges, or "one-key optimization" to automatically balance lighting and sharpen textures.

[0045] After model optimization, a high-precision 3D model can be generated. After saving the 3D model, users can share the 3D model with other users or directly share it in the community.

[0046] Preferably, users can also mark key parts (such as "insect mouthparts") on the model, add text annotations or voice explanations to form personalized learning materials.

[0047] In a preferred embodiment, the 3D printing module is further configured to display a pre-stored printing guide tutorial according to a user's printing instruction.

[0048] In specific practice, when users use the 3D printing module, the usage process is as follows Figure 3 , first, the user selects the 3D model to be printed, and then the system exports the 3D model into a format supported by the 3D printer, such as STL and OBJ formats, which are compatible with mainstream 3D printers. Users can directly select the printer model in the electronic specimen teaching system APP on the smart device, and the system automatically adapts the model size and printing parameters.

[0049] During printing, considering that users may not be proficient in 3D printing, users can choose to watch the printing guide tutorial in the electronic specimen teaching system APP. The electronic specimen teaching system APP provides video tutorials and graphic guides, covering the entire process from model preparation to post-processing, reducing the operation threshold for novices.

[0050] Preferably, during 3D printing, there is intelligent warning. When there are printing risks in the model (such as too large a hanging angle or insufficient base area), the system automatically pops up a prompt and provides modification suggestions, such as "it is recommended to add a 45° support structure", reducing the printing failure rate.

[0051] After printing out the physical specimen model, users can share the specimen in the community and give feedback.

[0052] In a preferred embodiment, the holographic imaging module is further configured to obtain a user's control instruction and adjust the form of the 3D model displayed by the holographic imaging device according to the control instruction; the control instruction includes: a gesture interaction instruction, and / or, a voice control instruction.

[0053] In specific practices, refer to the usage effect diagram of the holographic imaging module Figure 4 . Holographic projection devices such as Microsoft HoloLens and Magic Leap can be used to capture user actions and environmental data through the optical systems and sensors of the devices.

[0054] Generate and display the three-dimensional image of the specimen in the holographic projection device. The image can three-dimensionally present the details of the specimen, such as the wings of insects and the stamens of plants. The user operates the three-dimensional image through gestures (such as zooming and rotating) to adjust the viewing angle. Interact with the image through voice commands (such as "magnify" and "switch specimen") to improve the operation convenience.

[0055] It can be understood that the holographic projection technology realizes the three-dimensional dynamic display of the specimen, breaks through the limitations of traditional planar graphics or static specimens, and makes the observation more intuitive.

[0056] For the AR display module, AR development frameworks (SDKs) such as Unity AR Foundation or Vuforia are used to achieve the fusion rendering of virtual models and the real environment. The real scene image is captured in real time through the device camera as the background basis for AR overlay.

[0057] When the user uses the AR display module through an intelligent device, the virtual model and the real environment can be jointly displayed on the screen. The device sensors (such as gyroscopes and accelerometers) and computer vision algorithms can be used to track the user's position, movement direction, and environmental characteristics in real time. The digital specimen model can be fixed at a specific position (such as a desktop or the ground) in the real environment through the Anchor technology to ensure the relative position stability of the model and the environment.

[0058] The user can overlay the digital specimen model in the real environment to achieve a virtual-real combined observation experience.

[0059] Preferably, the electronic specimen teaching system further includes:

[0060] A data storage module for storing the scanned data, three-dimensional models, holographic images, pictures, and text-voice descriptions corresponding to natural specimens, and also for storing user data.

[0061] In specific practices, a specimen database can be established to store data such as pictures, voice descriptions, location information, 3D models, and holographic images of specimens. Cloud storage (such as Alibaba Cloud OSS, AWS S3) can be used to store the specimen data uploaded by users. Users can view and manage their specimen records at any time, with multi-device synchronization and cloud backup supported: The data storage module is also used to upload the stored data to the cloud for cloud storage; it is also used to synchronize the cloud-stored data to the current device according to user data when the user starts the electronic specimen teaching system through different devices.

[0062] For the user interface design, it is mainly in a child-friendly style, with bright colors and simple icons. Voice prompts and animation guides are provided to help child users get started easily.

[0063] In a preferred embodiment, the electronic specimen teaching system further includes: an interactive learning module for obtaining a sharing instruction from a user and sharing the 3D model with other users or communities according to the sharing instruction.

[0064] Learning outcomes (such as 3D printed works, 3D models) can be shared to the community with one key, triggering comments and interactions from other users, forming an ecological closed loop of "learning - creation - sharing". Thus, the learning interest of learners can be improved.

[0065] It should be noted that the electronic specimen teaching system further includes:

[0066] An account management module for managing user data; it is also used to bind the parent account and the student account according to the obtained user instruction.

[0067] Preferably, the binding of dual accounts can provide more room for operation. For example, tasks for dual accounts can be added to enhance parent-child interaction.

[0068] The technical solution shown in the present invention has the following technical effects:

[0069] Interactive experience upgrade: Integrating technologies such as 3D scanning, holographic imaging, and AR augmented reality to build a full-link experience of "digital acquisition - virtual interaction - physical creation". Users can manipulate the details of holographic specimens through gestures, complete interactive tasks in the AR scene, or print 3D models into physical objects for tactile exploration. The immersive interaction increases the learning participation rate by 50%.

[0070] Learning efficiency enhancement: Integrating the popular science knowledge base and gamified task design (such as AR ecological puzzles, holographic structure disassembly), transforming passive observation into active exploration. Measured data shows that the cognitive accuracy rate of users for biological characteristics increases by 40%, and the knowledge memory retention period is extended by 35%.

[0071] User stickiness optimization: Parent-child collaboration: The dual-account mode supports parents to customize the learning path and participate in the "Family Specimen Collection Challenge", increasing the frequency of parent-child interaction by 40%; Growth incentive: An achievement system (such as "Species Collection Medal") and data cloud synchronization function can be set, increasing the weekly average active user retention rate by 25%.

[0072] Data verification: Through user tests, it is proved that the proposed electronic specimen teaching system in the invention improves the user participation and learning effect by 50% compared with traditional tools.

[0073] It can be understood that the same or similar parts in the above embodiments can be referred to each other, and the content not detailed in some embodiments can be referred to the same or similar content in other embodiments.

[0074] It should be noted that in the description of the present invention, terms such as "first", "second", etc. are only used for descriptive purposes and cannot be understood as indicating or implying relative importance. In addition, in the description of the present invention, unless otherwise specified, the meaning of "a plurality of" refers to at least two.

[0075] Any process or method description shown in the flowchart or described in other ways herein can be understood as representing a module, segment, or part of code including one or more executable instructions for implementing a specific logical function or process, and the scope of the preferred embodiments of the present invention includes additional implementations, where the functions can be executed in a manner that is not shown or discussed in order, including in a substantially simultaneous manner or in a reverse order according to the functions involved, which should be understood by those skilled in the technical field to which the embodiments of the present invention belong.

[0076] It should be understood that each part of the present invention can be implemented by hardware, software, firmware, or a combination thereof. In the above embodiments, multiple steps or methods can be implemented by software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented by hardware, as in another embodiment, any one or a combination of the following technologies well known in the art can be used: discrete logic circuits with logic gate circuits for implementing logical functions on data signals, application-specific integrated circuits with appropriate combinational logic gate circuits, programmable gate arrays (PGAs), field programmable gate arrays (FPGAs), etc.

[0077] Those of ordinary skill in the technical field can understand that all or part of the steps carried by the methods of the above embodiments can be completed by instructing relevant hardware through a program, and the program can be stored in a computer-readable storage medium. When the program is executed, it includes one or a combination of the steps of the method embodiments.

[0078] In addition, each functional unit in various embodiments of the present invention may be integrated into a processing module, or each unit may exist physically alone, or two or more units may be integrated into one module. The above-mentioned integrated module may be implemented in the form of hardware or in the form of a software functional module. When the integrated module is implemented in the form of a software functional module and sold or used as an independent product, it may also be stored in a computer-readable storage medium.

[0079] The above-mentioned storage medium may be a read-only memory, a magnetic disk, an optical disc, or the like.

[0080] In the description of this specification, the description with reference to the terms "one embodiment", "some embodiments", "example", "specific example", or "some examples", etc. means that the specific features, structures, materials, or characteristics described in connection with the embodiment or example are included in at least one embodiment or example of the present invention. In this specification, the schematic representation of the above terms does not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials, or characteristics described may be combined in a suitable manner in any one or more embodiments or examples.

[0081] Although the embodiments of the present invention have been shown and described above, it can be understood that the above embodiments are exemplary and should not be construed as limiting the present invention. Those of ordinary skill in the art can make changes, modifications, substitutions, and variations to the above embodiments within the scope of the present invention.

Claims

1. An electronic specimen teaching system, characterized in that: include: 3D scanning module, 3D printing module, holographic imaging module and AR display module; The 3D scanning module is used to scan the natural specimen through the 3D scanning function of the scanning device, and to establish a three-dimensional model of the natural specimen according to the scanning data; The 3D printing module is used to export the three-dimensional model in a preset format and send the exported file to a 3D printer according to a user printing instruction; The holographic imaging module is used to connect with the holographic imaging device and send the three-dimensional model to the holographic imaging device so that the holographic imaging device displays the three-dimensional model; The AR display module is used to render the three-dimensional model into a real scene image according to the user's operation on the smart device.

2. The electronic specimen teaching system according to claim 1, characterized in that: The 3D scanning module is also used to call the AI ​​algorithm to optimize the three-dimensional model.

3. The electronic specimen teaching system according to claim 1, characterized in that: The 3D printing module is also used to display a pre-stored printing guide tutorial according to the user's printing instruction.

4. The electronic specimen teaching system according to claim 1, characterized in that: The holographic imaging module is also used to obtain user control instructions and adjust the shape of the three-dimensional model displayed by the holographic imaging device according to the control instructions; the control instructions include: gesture interaction instructions, and / or voice control instructions.

5. The electronic specimen teaching system according to claim 1, characterized in that: Also includes: The data storage module is used to store scanned data, three-dimensional models, holographic images, pictures and text and voice descriptions corresponding to natural specimens, and is also used to store user data.

6. The electronic specimen teaching system according to claim 5, characterized in that: The data storage module is also used to upload the stored data to the cloud for cloud storage; it is also used to synchronize the cloud-stored data to the current device according to the user data when the user starts the electronic specimen teaching system through different devices.

7. The electronic specimen teaching system according to claim 1, characterized in that: Also includes: The interactive learning module is used to obtain the user's sharing instruction and share the three-dimensional model with other users or communities according to the sharing instruction.

8. The electronic specimen teaching system according to claim 5, characterized in that: Also includes: The account management module is used to manage user data; it is also used to bind parent accounts and student accounts based on the obtained user instructions.

Images