Chemical experiment learning interaction method, system and application based on augmented reality technology

By capturing environmental images and detection planes in augmented reality technology and matching instrument models in real time, users can explore and build chemical experiment instruments on their own and unlock virtual content. This solves the problem of lack of interactivity in the design of virtual content in existing technologies and achieves a more in-depth chemical experiment learning experience.

CN113934293BActive Publication Date: 2025-11-18OCEAN UNIV OF CHINA
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
CN202111081326.8
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-09-15
Publication Date
2025-11-18
Estimated Expiration
2041-09-15

AI Technical Summary

Technical Problem

Existing augmented reality learning methods lack interactive design in the virtual content registration process, which prevents users from deeply learning about chemical experiments during target recognition and also lacks fun and exploration.

Method used

By collecting environmental image information, detecting planes and establishing a spatial coordinate system, the data information of the model is matched in real time to generate a virtual instrument model, and interactive content is matched according to the model combination method. Users can explore and build chemical experimental instruments on their own and unlock virtual content through basic building blocks.

Benefits of technology

It improves the learning effectiveness and interest of users in chemical experiments, enhances the immersion and exploration of the learning process, and avoids the spatial, time and resource limitations of traditional learning.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN113934293B_ABST
    Figure CN113934293B_ABST
Patent Text Reader

Abstract

The application belongs to the technical field of teaching model construction, and discloses a chemical experiment learning interaction method, system and application based on augmented reality technology. Environmental image information is collected, a plane is detected, a space coordinate system is established, and instrument model and position information are detected. Data information of the current model is collected and extracted in real time, and is compared with model data information in a database. Once successful matching is achieved, a corresponding virtual instrument model is generated. After the next instrument model is built and a new virtual instrument model is generated, a preset combination mode of the existing virtual instrument model is matched, and the system automatically combines all existing virtual instrument models. Subsequent interaction content and virtual content are matched according to the model combination mode. Users are required to explore and build the recognition object by themselves, to help the users to deeply explore the structure of the chemical experiment instrument, to deepen the user's impression of the related knowledge, and to improve the learning effect.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This invention belongs to the field of teaching model construction technology, and particularly relates to a chemical experiment learning interaction method and system based on augmented reality technology, a computer-readable medium, and an electronic device. Background Technology

[0002] Augmented Reality (AR) technology enriches the real-world environment by overlaying virtual content, offering features such as immersion, interactivity, and real-time capabilities. In recent years, AR technology has developed rapidly and has enormous application potential across various fields.

[0003] In the field of learning, augmented reality (AR) technology significantly reduces teaching resource costs, avoids many shortcomings of traditional learning, and provides learners with a more engaging and interactive learning experience. Chemistry experiments are an important part of chemistry learning, but they are often limited by time, space, material resources, and safety concerns. Therefore, introducing AR technology to address these issues is necessary.

[0004] However, existing augmented reality learning methods mostly generate virtual content directly or by scanning complete objects or paper textbooks, lacking interactive design in the virtual content registration process. This approach only focuses on the presentation of virtual content, and users can only rely on subsequent virtual content for learning, thus failing to gain a sufficiently deep understanding of the learning material. This is especially true in chemistry experiment learning, where the key points lie not only in the experimental results and material reaction phenomena but also in learning about the experimental apparatus.

[0005] The patent with publication number CN113077669A discloses an auxiliary learning device, system and method based on AR toys. The auxiliary learning terminal is used to identify AR toys through AR recognition function. This patent has a clear and direct target identification object, but lacks the interactive design for building and obtaining the target identification object in the virtual content registration process.

[0006] Patent CN113126761A discloses a textbook interaction system based on AR (Augmented Reality) and image recognition, but it also uses explicit and direct target recognition objects. Therefore, there is an urgent need for a method and system that improves users' learning of corresponding content by designing an interactive method for virtual content registration, especially for application in the field of chemical experiment learning.

[0007] Based on the above analysis, the problems and shortcomings of the existing technology are as follows:

[0008] (1) The existing virtual content registration process is simple, mostly through direct generation or direct scanning of target identification objects, which lacks fun and exploration.

[0009] (2) The explicit definition of target object identification prevents users from learning related content while identifying the target object.

[0010] (3) There is a lack of similar interactive methods and systems for learning chemistry experiments based on augmented reality, especially those designed for target identification.

[0011] The difficulty in addressing the above problems and shortcomings lies in the following: the interaction design needs to be logical, ensuring a good user experience and effective learning of relevant knowledge while considering the computing power of general devices. Chemical experiments involve numerous and complex knowledge points, requiring a reasonable design of the interaction flow based on the specific content and characteristics of chemical experiments, clearly presenting relevant knowledge while stimulating user interest in learning.

[0012] The significance of addressing the above problems and shortcomings is that augmented reality-based chemistry experiment learning circumvents many limitations of traditional learning methods, such as spatial, temporal, resource, and security constraints. By designing the virtual content registration process, the learning effect on users is enhanced, the learning process is made more interesting and exploratory, and the user experience is improved. Chemistry is one of the most important subjects in life and education; combining augmented reality with chemistry learning in an innovative and unique way can make learning easier and more enjoyable for users, and also make chemistry more appealing to a wider audience. Summary of the Invention

[0013] To overcome the problems existing in related technologies, this invention discloses an embodiment of a chemical experiment learning interaction method and system based on augmented reality technology. The chemical experiment learning interaction method based on augmented reality technology includes:

[0014] Collect environmental image information, detect planes, establish a spatial coordinate system, and detect and build instrument models and their location information;

[0015] The system collects and extracts data from the currently built model in real time, compares it with the model data in the database, and generates the corresponding virtual instrument model once a match is found.

[0016] After building the next instrument model and generating a new virtual instrument model, the system automatically combines all existing virtual instrument models by matching the preset combination method of the existing virtual instrument models.

[0017] The model combination method is used to match subsequent interactive content and virtual content.

[0018] In one embodiment, the interactive learning method for chemical experiments based on augmented reality technology specifically includes the following steps:

[0019] Step 1: Prompt the user to scan the environment, collect environmental image information, extract environmental feature points to detect planes, and establish a spatial coordinate system;

[0020] Step 2: During the user's exploration and model building process, the data information of the current model building is collected and extracted in real time, and the extracted model building data information is compared with the model data information in the database. Once a successful match is found, the corresponding text prompt information is displayed, and the corresponding virtual instrument model is generated after the instrument model is built.

[0021] Step 3: After generating a new virtual instrument model, the user is prompted to choose whether to build the next instrument model.

[0022] Step 4: After completing the combination of virtual instrument models, match the corresponding experimental scheme according to the combination of existing virtual instrument models and prompt the user to select an experimental scheme.

[0023] Step 5: Match the reactants according to the experimental scheme selected by the user and display the icons of each reactant on the screen;

[0024] Step six: After placing the reactants, the user is prompted to view the reaction process and results, which are presented as virtual content.

[0025] In one embodiment, in step one, the user is prompted to explore and build an instrument model on a plane using basic building blocks, and the position information of the built instrument in space is detected in real time to prepare for the establishment of the corresponding virtual instrument model.

[0026] In one embodiment, in step two, the user explores the basic building block construction method on their own. Only when the real-time extracted construction model data matches a certain model data in the database can the corresponding virtual instrument model be unlocked and generated.

[0027] In one embodiment, in step three, if the user chooses to build the next instrument model, the user uses basic building blocks to explore and build a new instrument model. If a match is successful, a new virtual instrument model is generated. If the new virtual instrument model has a preset combination method with the previously generated virtual instrument model, corresponding text prompts are displayed. The system generates a virtual connection model for combination and automatically combines all existing virtual instrument models; or...

[0028] If the user chooses not to build the next instrument model, the virtual instrument model combination is completed.

[0029] If the new virtual instrument model does not have a preset combination with the previously generated virtual instrument model, a corresponding text prompt will be displayed, the newly generated virtual instrument model will disappear, and the user will be prompted to choose whether to build the next instrument model.

[0030] In one embodiment, in step five, the user is prompted to select and drag any reactant icon to the corresponding virtual instrument model to place the reactant.

[0031] Another object of the present invention is to provide a system for implementing the aforementioned chemical experiment learning interaction method based on augmented reality technology, the chemical experiment learning interaction system based on augmented reality technology comprising:

[0032] Multiple basic building blocks for building models of chemical experimental instruments;

[0033] The information acquisition module is used to collect image information of the environment, as well as image and location information of the constructed instrument model;

[0034] The data processing module is used to establish a spatial coordinate system based on the collected environmental information detection plane; determine the position of the virtual instrument model based on the collected instrument location information; extract feature data based on the collected instrument image information and match it to obtain the corresponding virtual instrument model; match the existing virtual instrument model with a preset combination method and generate a virtual connection model; and match the experimental scheme and corresponding virtual content based on the instrument combination method.

[0035] The interactive display module is used to display interactive content and virtual content.

[0036] Another object of the present invention is to provide a computer-readable medium storing an augmented reality-based chemical experiment learning program, which, when executed by a processor, implements the steps of the augmented reality-based chemical experiment learning interactive method.

[0037] Another object of the present invention is to provide a computer program product stored on a computer-readable medium, including a computer-readable program that, when executed on an electronic device, provides a user input interface to implement the aforementioned interactive chemical experiment learning method based on augmented reality technology.

[0038] Another object of the present invention is to provide an electronic device comprising at least one memory, a processor, and a program stored in the memory and executable on the processor, wherein the processor executes the program to implement the steps in the chemical experiment learning interaction method based on augmented reality technology.

[0039] Combining all the above technical solutions, the advantages and positive effects of this invention are as follows: The chemical experiment learning interaction method and system based on augmented reality technology provided by this invention requires users to explore and build identification objects themselves, helping users to deeply explore the structure of chemical experimental instruments, deepen their impression of relevant knowledge, and thus improve learning effectiveness. By not explicitly providing target identification objects, but allowing users to blindly build with basic blocks to unlock virtual content, it provides users with a more interesting instrument building and learning experience. Furthermore, subsequent interactive processes allow users to continue to learn more about the combination of chemical experimental instruments, reactants, reaction processes, and results.

[0040] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and are not intended to limit the disclosure of the present invention. Attached Figure Description

[0041] The accompanying drawings, which are incorporated in and form a part of this specification, illustrate embodiments consistent with this disclosure and, together with the description, serve to explain the principles of this disclosure.

[0042] Figure 1 This is a flowchart of an augmented reality-based chemical experiment learning interaction method provided in an embodiment of the present invention.

[0043] Figure 2 This is a schematic diagram of an interactive learning scenario for chemical experiments based on augmented reality provided in an embodiment of the present invention;

[0044] Wherein, a is a schematic diagram of the detection scenario built by the instrument model; b is a schematic diagram of the scenario successfully generated by the virtual instrument model corresponding to the instrument model; c is a schematic diagram of the detection scenario built by the next instrument model; d is a schematic diagram of the scenario successfully combined by the existing virtual models; and e is a schematic diagram of the scenario where the reactants are placed.

[0045] Figure 3 This is a schematic diagram of an augmented reality-based chemical experiment learning and interaction system provided in an embodiment of the present invention.

[0046] Figure 4 This is a flowchart of the virtual content matching setting process for user interaction permissions during real-time interaction provided in this embodiment of the invention.

[0047] Figure 5 This is an exploded view of an instrument model structure built from basic building blocks, provided in an embodiment of the present invention.

[0048] Wherein, a is the exploded view of the test tube model; b is the exploded view of the beaker model; c is the exploded view of the conical flask model; d is the exploded view of the round-bottom flask model; e is the exploded view of the flat-bottom flask model; and f is the exploded view of the alcohol lamp model.

[0049] Figure 6This is an example diagram of a complete instrument model structure built from basic building blocks, provided in an embodiment of the present invention.

[0050] Wherein, a is the structural diagram of the test tube model; b is the structural diagram of the beaker model; c is the structural diagram of the conical flask model; d is the structural diagram of the round-bottom flask model; e is the structural diagram of the flat-bottom flask model; and f is the structural diagram of the alcohol lamp model.

[0051] Figure 7 This is an example diagram of an instrument model built from basic building blocks and its corresponding virtual model provided in an embodiment of the present invention;

[0052] Wherein, a is a test tube model diagram; b is a beaker model diagram; c is an Erlenmeyer flask model diagram; d is a round-bottom flask model diagram; e is a flat-bottom flask model diagram; and f is an alcohol lamp model diagram.

[0053] In the diagram: 201, Virtual flat-bottomed flask model; 202, Virtual beaker model; 203, Virtual tubing model; 301, Basic building blocks; 302, Information acquisition module; 303, Data processing module; 304, Interactive display module. Detailed Implementation

[0054] To make the above-mentioned objects, features, and advantages of the present invention more apparent and understandable, specific embodiments of the present invention will be described in detail below with reference to the accompanying drawings. Many specific details are set forth in the following description to provide a thorough understanding of the present invention. However, the present invention can be practiced in many other ways different from those described herein, and those skilled in the art can make similar modifications without departing from the spirit of the present invention. Therefore, the present invention is not limited to the specific embodiments disclosed below.

[0055] It should be noted that when an element is referred to as being "fixed to" another element, it can be directly attached to the other element or there may be an intervening element. When an element is referred to as being "connected to" another element, it can be directly connected to the other element or there may be an intervening element. The terms "vertical," "horizontal," "left," "right," and similar expressions used in this invention are for illustrative purposes only and do not represent the only possible implementation.

[0056] Unless otherwise defined, all technical and scientific terms used in this invention have the same meaning as commonly understood by one of ordinary skill in the art to which this invention pertains. The terminology used in this specification is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. The term "and / or" as used herein includes any and all combinations of one or more of the associated listed items.

[0057] A chemical experiment learning interaction method and system based on augmented reality (AR) technology is disclosed. The AR-based chemical experiment learning interaction method includes: acquiring environmental image information, detecting planes, establishing a spatial coordinate system, and detecting and constructing instrument models and their position information; real-time acquisition and extraction of data information of the currently constructed model, comparing it with model data information in a database, and generating a corresponding virtual instrument model upon successful matching; after constructing the next instrument model and generating a new virtual instrument model, matching the existing virtual instrument models with preset combination methods, and the system automatically combining all existing virtual instrument models; and matching subsequent interactive content and virtual content according to the model combination method. This invention helps users to deeply explore the structure of chemical experimental instruments by requiring them to explore and construct identification objects themselves, deepening their impression of relevant knowledge, thereby improving learning effectiveness and increasing the fun of the learning process.

[0058] This invention provides a chemical experiment learning interaction method based on augmented reality technology, comprising:

[0059] S101. Prompt the user to scan the environment, collect environmental image information, extract environmental feature points to detect the plane, and establish a spatial coordinate system. Prompt the user to explore and build an instrument model on the plane using basic building blocks, and detect the position information of the built instrument in space in real time. This prepares for the establishment of the corresponding virtual instrument model in subsequent steps;

[0060] S102. During the user's exploration and model building process, the data information of the current model building is collected and extracted in real time, and the extracted model building data information is compared with the model data information in the database. Once a successful match is achieved, the corresponding text prompt information is displayed, and the corresponding virtual instrument model is generated after the instrument model is built.

[0061] S103. After generating a new virtual instrument model, the user is prompted to choose whether to build the next instrument model. If the user chooses to build the next instrument model, the user uses basic building blocks to explore and build the new instrument model. If a match is successfully made, a new virtual instrument model is generated. If the new virtual instrument model has a preset combination method with the previously generated virtual instrument model, the corresponding text prompt information is displayed, the system generates a virtual connection model for combination, and automatically combines all existing virtual instrument models.

[0062] S104. After completing the virtual instrument model combination, match the corresponding experimental scheme according to the existing virtual instrument model combination form and prompt the user to select the experimental scheme.

[0063] S105. Match reactants according to the experimental scheme selected by the user and display icons of each reactant on the screen. Prompt the user to select and drag any reactant icon to the corresponding virtual instrument model to place the reactant;

[0064] S106. After the reactants are placed, the user is prompted to view the reaction process and results, which are presented as virtual content.

[0065] In S102, users need to explore the basic building blocks themselves. Only when the real-time extracted model data matches a model in the database can the corresponding virtual instrument model be unlocked and generated. This interactive process helps users independently explore and learn about chemical experimental instruments and their selection.

[0066] In S103, if the user chooses not to build the next instrument model, the virtual instrument model combination is completed.

[0067] In S103, if the new virtual instrument model does not have a preset combination with the previously generated virtual instrument model, a corresponding text prompt will be displayed, the generated new virtual instrument model will disappear, and the user will be prompted to choose whether to build the next instrument model.

[0068] The interaction method provided by the present invention will be described in detail below with reference to specific embodiments.

[0069] The system prompts the user to turn on the camera, select a plane, and scan to collect environmental image information, extract environmental feature points to detect the plane, and establish a spatial coordinate system.

[0070] like Figure 2 As shown in (a), the user is prompted to use the basic building block 301 to explore and build an instrument model on the plane selected in the previous step, and to detect the position information of the instrument in space in real time, in order to prepare for the establishment of the corresponding virtual instrument model in the following steps.

[0071] Users can only explore the building methods of basic building block 301 on their own. During the user's model building process, the system collects and extracts data information of the currently built model in real time, and compares the extracted data information with the model data information in the database each time. For example Figure 2 As shown in (b), when the user correctly builds the flat-bottomed flask model, the built flat-bottomed flask model data is successfully matched with the corresponding flat-bottomed flask model data in the database, prompting the user that the flat-bottomed flask model has been successfully unlocked, and a corresponding virtual flat-bottomed flask model 201 is generated after the built flat-bottomed flask model.

[0072] After generating the virtual flat-bottomed flask model 201, the user is prompted to choose whether to proceed to building the next instrument model. If the user chooses to proceed, they can use the basic building block 301 to explore and build new instrument models, such as... Figure 2(c) As shown. Once the constructed beaker model is successfully recognized, a virtual beaker model 202 is generated. If the virtual beaker model 202 and the virtual flat-bottomed flask model 201 have a preset combination method, the user is prompted that the model combination is successful, and a virtual connection model: a virtual conduit model 203, is automatically generated. The existing virtual flat-bottomed flask model 201, virtual beaker model 202, and virtual conduit model 203 are then combined, as shown in (c). Figure 2 As shown in (d), the user is prompted to choose whether to proceed with the construction of the next instrument model.

[0073] If the virtual beaker model 202 and the virtual flat-bottomed flask model 201 do not have a preset combination method, the user will be prompted that the model combination has failed, the virtual beaker model 202 will disappear, and the user will be prompted to choose whether to build the next instrument model.

[0074] If the user chooses not to build the next instrument model, the virtual instrument model combination is completed.

[0075] After the virtual instrument model combination is completed, the corresponding experimental scheme is matched according to the combination form of the existing virtual instrument model, and the user is prompted to select an experimental scheme.

[0076] Based on the user-selected experimental protocol, reactants are matched, and icons for each reactant (m1-m3) are displayed on the screen. The user is prompted to select and drag m1-m3 sequentially to the corresponding instrument model to place the reactants, such as... Figure 2 As shown in (e). The system recognizes user finger movements, including a start state, a moving state, and an end state. When the finger is in a moving state, the position of the reactant changes accordingly. In the end state, when the finger leaves the screen, the system identifies whether a ray emitted from the finger's position along the screen's normal direction collides with the virtual instrument model. If a collision occurs, the reactant is successfully placed into the corresponding instrument of the collided virtual instrument model; otherwise, the user is prompted to reposition it.

[0077] After the reactants are placed, the user is prompted to view the reaction process and results, which are presented as virtual content.

[0078] Figure 3 This is a schematic diagram of the augmented reality-based chemical experiment learning and interactive system provided by the present invention. Figure 3 As shown, the present invention provides an interactive learning system for chemical experiments based on augmented reality, including multiple basic building blocks 301, an information acquisition module 302, a data processing module 303, and an interactive display module 304.

[0079] The basic building block 301 is used to build models of chemical experimental instruments, such as... Figure 5 , Figure 6As shown, users can freely build using the basic building blocks 301. The basic building blocks 301 can be combined in different ways to build different instruments, including but not limited to test tubes, beakers, conical flasks, round-bottom flasks, flat-bottom flasks, and alcohol lamps.

[0080] The information acquisition module 302 is used to acquire image information of the environment, image information and location information of the constructed instrument model;

[0081] The data processing module 303 is used to establish a spatial coordinate system based on the collected environmental information detection plane; determine the position of the virtual instrument model based on the collected instrument location information; extract feature data based on the collected instrument image information and match it to obtain the corresponding virtual instrument model; match a preset combination method based on the existing virtual instrument model and generate a virtual connection model; and match the experimental scheme and corresponding virtual content based on the instrument combination method.

[0082] The interactive display module 304 is used to display interactive content and virtual content.

[0083] Furthermore, the present invention also provides a computer-readable medium storing an augmented reality-based chemical experiment learning program, which, when executed by a processor, implements the steps in the above-described augmented reality-based chemical experiment learning interactive method.

[0084] In addition, the present invention also provides an electronic device, including at least one memory, a processor, and a program stored in the memory and executable on the processor, wherein the processor executes the program to implement the steps in the above-described augmented reality-based chemical experiment learning interaction method.

[0085] Other embodiments of this disclosure will readily occur to those skilled in the art upon consideration of the specification and practice of the disclosure herein. This application is intended to cover any variations, uses, or adaptations of this disclosure that follow the general principles of this disclosure and include common knowledge or customary techniques in the art not disclosed herein. The specification and embodiments are to be considered exemplary only, and the true scope and spirit of this disclosure are indicated by the appended claims. It should be understood that this disclosure is not limited to the precise structures described above and shown in the drawings, and various modifications and changes can be made without departing from its scope. The scope of this disclosure should be limited by the appended claims.

Claims

1. A chemical experiment learning interaction method based on augmented reality technology, characterized in that, The chemical experiment learning interaction method based on augmented reality technology includes: Collect environmental image information, detect planes, establish a spatial coordinate system, and detect and build instrument models and their location information; The system collects and extracts data from the currently built model in real time, compares it with the model data in the database, and generates the corresponding virtual instrument model once a match is found. After building the next instrument model and generating a new virtual instrument model, the system automatically combines all existing virtual instrument models by matching the preset combination method of the existing virtual instrument models. The subsequent interactive content and virtual content are matched according to the model combination method; This interactive learning method for chemistry experiments based on augmented reality technology includes the following steps: Step 1: Prompt the user to scan the environment, collect environmental image information, extract environmental feature points to detect planes, and establish a spatial coordinate system; Step 2: During the user's exploration and model building process, the data information of the current model building is collected and extracted in real time, and the extracted model building data information is compared with the model data information in the database. Once a successful match is found, the corresponding text prompt information is displayed, and the corresponding virtual instrument model is generated after the instrument model is built. Step 3: After generating a new virtual instrument model, the user is prompted to choose whether to build the next instrument model. Step 4: After completing the combination of virtual instrument models, match the corresponding experimental scheme according to the combination of existing virtual instrument models and prompt the user to select an experimental scheme. Step 5: Match the reactants according to the experimental scheme selected by the user and display the icons of each reactant on the screen; Step six: After placing the reactants, the user is prompted to view the reaction process and results, which are presented as virtual content.

2. The chemical experiment learning interaction method based on augmented reality technology according to claim 1, characterized in that, In step one, the user is prompted to use basic building blocks on a plane to explore and build an instrument model, and the position information of the built instrument in space is detected in real time to prepare for the creation of the corresponding virtual instrument model.

3. The chemical experiment learning interaction method based on augmented reality technology according to claim 1, characterized in that, In step two, users explore the basic building blocks on their own. Only when the real-time extracted building model data matches a certain model data in the database can the corresponding virtual instrument model be unlocked and generated.

4. The chemical experiment learning interaction method based on augmented reality technology according to claim 1, characterized in that, In step three, if the user chooses to build the next instrument model, the user uses basic building blocks to explore and build a new instrument model. If a match is successful, a new virtual instrument model is generated. If the new virtual instrument model has a preset combination method with the previously generated virtual instrument model, the corresponding text prompt information is displayed, the system generates a virtual connection model for combination, and automatically combines all existing virtual instrument models. Alternatively, if the user chooses not to build the next instrument model, the combination of virtual instrument models is completed.

5. The chemical experiment learning interaction method based on augmented reality technology according to claim 4, characterized in that, If the new virtual instrument model does not have a preset combination with the previously generated virtual instrument model, a corresponding text prompt will be displayed, the newly generated virtual instrument model will disappear, and the user will be prompted to choose whether to build the next instrument model.

6. The chemical experiment learning interaction method based on augmented reality technology according to claim 1, characterized in that, In step five, the user is prompted to select and drag any reactant icon to the corresponding virtual instrument model to place the reactant.

7. A system for implementing the interactive learning method for chemical experiments based on augmented reality technology as described in any one of claims 1-6, characterized in that, This interactive chemistry experiment learning system based on augmented reality technology includes: Multiple basic building blocks for building models of chemical experimental instruments; The information acquisition module is used to collect image information of the environment, as well as image and location information of the constructed instrument model; The data processing module is used to establish a spatial coordinate system based on the collected environmental information detection plane; determine the position of the virtual instrument model based on the collected instrument location information; extract feature data based on the collected instrument image information and match it to obtain the corresponding virtual instrument model; match the existing virtual instrument model with a preset combination method and generate a virtual connection model; and match the experimental scheme and corresponding virtual content based on the instrument combination method. The interactive display module is used to display interactive content and virtual content.

8. A computer-readable medium, characterized in that, The computer-readable medium stores an augmented reality-based chemical experiment learning program, which, when executed by a processor, implements the steps of the augmented reality-based chemical experiment learning interactive method according to any one of claims 1-6.

9. An electronic device, characterized in that, The electronic device includes at least one memory, a processor, and a program stored in the memory and executable on the processor. When the processor executes the program, it implements the steps of the chemical experiment learning interaction method based on augmented reality technology as described in any one of claims 1-6.

Citation Information

Patent Citations

  • Auxiliary learning device, system and method based on AR toy

    CN113077669A

  • Teaching material interaction system based on AR augmented reality and graph recognition

    CN113126761A

  • Display method and apparatus

    CN107066082A

  • Teaching system with simulation experiment function

    CN110718107A

  • Automation of laboratory processes by means of a laboratory-process support device

    WO2020174080A1