Teaching experiment simulation method, system and device and storage medium
The virtual experimental scenario is constructed through virtual reality technology, which solves the safety hazards faced by students in experimental teaching, and achieves safe and efficient experimental operation and learning effects.
Patent Information
- Application Number
- CN202411362073.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-09-27
- Publication Date
- 2025-02-11
AI Technical Summary
In experimental teaching, students may face safety hazards such as electricity safety and chemical accidents, which will affect their safety and learning results.
Through virtual reality technology, students can conduct experiments in a virtual environment to avoid safety hazards in actual experiments. The system includes steps of obtaining experimental tasks, generating virtual experimental equipment, obtaining motion capture information, and generating virtual interaction results.
This method effectively avoids possible safety hazards in traditional experiments and provides a safe environment for students to conduct experiment operations freely. At the same time, it recognizes and corrects students' wrong operations in real time, improving the safety and learning efficiency of the experiment.
Smart Images
Figure CN119418569A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the technical field of virtual reality, and in particular to a simulation method, system, device and storage medium for teaching experiments. Background Art
[0002] At present, the school mainly adopts the method of theoretical explanation + experimental operation in experimental teaching. Going to the laboratory for practical operation can deepen students' understanding of the experimental content and help cultivate students' scientific thinking. However, for students with insufficient safety awareness, there may be electrical safety, chemical accidents or other safety hazards. Therefore, how to ensure the personal safety of students in teaching experiments is a technical problem that needs to be solved urgently. Summary of the invention
[0003] The purpose of this application is to ensure the personal safety of students during teaching experiments.
[0004] The above technical objectives of this application are achieved through the following technical solutions: A simulation method for a teaching experiment, the method comprising: Obtaining experimental tasks; obtaining required data in the database according to the experimental objectives; Generate virtual experimental equipment according to the demand data, and establish a mapping relationship between the virtual experimental equipment; Obtain motion capture information of the target user; According to the mapping relationship, a virtual interaction result between the motion capture information and the experimental equipment is generated.
[0005] By adopting the above technical solution, virtual reality equipment is used to build a virtual scene, and experimental operations are carried out in the virtual scene, thereby ensuring the personal safety of students in teaching experiments.
[0006] Optionally, the method further includes: Obtaining experimental tutorial information of the experimental task; Obtaining a playback instruction from a target user, and playing the experimental tutorial information of the experimental task according to the playback instruction; Determine the experimental specifications according to the tutorial information, wherein the experimental specifications are divided into primary experimental specifications and secondary experimental specifications; Determining whether the target user violates the first-level experimental specification or the second-level experimental specification according to the motion capture information; If the target user violates the first-level experimental specification, a first prompt message is sent to the target user, and the experimental tutorial information is shown; If the target user violates the secondary experiment specification, a second prompt message is sent to the target user, and the experiment tutorial information is shown, and then the current experiment is restarted.
[0007] By adopting the above technical solutions, students' incorrect experimental operations can be corrected in time, and experiments can be repeated for incorrect operations that may cause serious adverse consequences, thus cultivating students' standardized experimental thinking.
[0008] Optionally, after the step of determining whether the target user violates the primary experimental specification or the secondary experimental specification according to the motion capture information, the method further includes: Determine whether the target user violates the first-level experimental specification more than a preset number of times; If the target user violates the first-level experimental specification for more than a preset number of times, the experimental tutorial information is shown and then the current experiment is restarted.
[0009] By adopting the above technical solution, if the target user violates the primary experimental specification too many times, the experimental result will have a large error, so the experiment is restarted to provide the target user with an opportunity to try again.
[0010] Optionally, the method further includes: Determine the experimental scoring criteria according to the experimental specifications; A target user experimental evaluation is generated based on the motion capture information and combined with the scoring criteria.
[0011] By adopting the above technical solution, students' experimental results can be objectively evaluated according to the specifications, which helps students or teachers understand their mastery of the experimental content through experimental evaluation.
[0012] Optionally, if the target user completes the experimental task, after the step of generating a simulation experiment result according to the mapping relationship and recording the experimental data, the method further includes: Get playback video of completed experiments; Obtain the playback instruction of the target user, and play the experimental playback video according to the playback instruction.
[0013] By adopting the above technical solution, the video of the experimental playback is automatically recorded, and the user can replay the video as needed, which is convenient for understanding the details of the experiment and also convenient for students to review the experimental content and write experimental reports.
[0014] Optionally, after the step of obtaining a playback instruction from a target user and playing the experimental playback video according to the playback instruction, the method further includes: Obtain a speed adjustment instruction from a target user, and adjust the playback speed of the experimental playback video according to the speed adjustment instruction.
[0015] By adopting the above technical solution, for a slower or faster changing process, the playback speed can be adjusted during playback to observe carefully, which is convenient for students to understand the experimental content.
[0016] Optionally, after the step of obtaining a playback instruction from a target user and playing the experimental playback video according to the playback instruction, the method further includes: Obtain a retry instruction from a target user, and determine a retry node according to the retry instruction; The retry node is loaded, and the target user starts from the retry node and re-performs the experiment.
[0017] By adopting the above technical solution, users can retry the experimental steps in the completed experimental tasks that are not performed in a standardized manner, thereby avoiding the time waste of restarting the experiment and improving learning efficiency.
[0018] On the other hand, the present application discloses a simulation system for teaching experiments, comprising: A task acquisition module, used to acquire an experimental task, wherein the experimental task includes experimental target requirements; A data acquisition module is used to acquire the required data in the database according to the experimental target requirements; A scene construction module, used to generate virtual experimental equipment according to the demand data and establish a mapping relationship between the virtual experimental equipment; A motion capture module, used to obtain motion capture information of the target user; The experimental simulation module is used to generate a virtual interaction result between the motion capture information and the experimental equipment according to the mapping relationship.
[0019] On the other hand, the present application discloses a device including a memory and a processor, wherein the memory stores a computer program that can be loaded by the processor and loads the simulation method of the above-mentioned teaching experiment.
[0020] On the other hand, the present application discloses a storage medium storing a computer program that can be loaded by a processor and execute the simulation method of the above-mentioned teaching experiment.
[0021] In summary, the present application has at least one of the following beneficial effects: 1. The experimental scene constructed by virtual reality technology avoids high voltage power supply, dangerous chemical reagents, fire source and other potential safety hazards that may exist in traditional experimental class teaching. It is more friendly to students who are not yet proficient in experimental operations, allowing students to boldly try experimental operations.
[0022] 2. In the experimental simulation, it is possible to identify in real time whether the students' operations comply with the experimental specifications, and to promptly correct the students' incorrect experimental operations to deepen the students' impression of the experimental content. At the same time, for incorrect experimental operations that may cause serious adverse consequences, the experiment is terminated and restarted, thereby severely warning the students to avoid such dangerous operations from happening again.
[0023] 3. After the experiment is completed, you can understand the details of the experiment by replaying the video, which is also convenient for students to review the experimental content and write experimental reports. At the same time, for slower or faster changes, you can adjust the playback speed during playback to observe carefully, which is convenient for students to understand the experimental content. You can also re-operate the experimental steps that are not standardized in the completed experimental tasks, avoiding the waste of time starting over and improving learning efficiency. BRIEF DESCRIPTION OF THE DRAWINGS
[0024] Figure 1 It is a flowchart of steps of an embodiment of the simulation method of the teaching experiment of the present application; Figure 2 It is a system block diagram of an embodiment of a simulation system for teaching experiments in this application. DETAILED DESCRIPTION
[0025] The present application is further described in detail below in conjunction with the accompanying drawings. The following examples will help those skilled in the art to further understand the effects of the present application, but do not limit the present application in any form. It should be noted that, for those of ordinary skill in the art, several variations and improvements can also be made without departing from the concept of the present application. These all belong to the protection scope of the present application.
[0026] In the following description, specific details such as specific system structures, technologies, etc. are provided for the purpose of illustration rather than limitation, so as to provide a thorough understanding of the embodiments of the present application. However, it should be clear to those skilled in the art that the present application may also be implemented in other embodiments without these specific details. In other cases, detailed descriptions of well-known systems, devices, circuits, and methods are omitted to prevent unnecessary details from obstructing the description of the present application.
[0027] It should be understood that when used in the present specification and the appended claims, the term "comprising" indicates the presence of described features, wholes, steps, operations, elements and / or components, but does not exclude the presence or addition of one or more other features, wholes, steps, operations, elements, components and / or combinations thereof.
[0028] It should also be understood that the term “and / or” used in the specification and appended claims refers to any and all possible combinations of one or more of the associated listed items, and includes these combinations.
[0029] As used in the specification and appended claims of this application, the term "if" can be interpreted as "when" or "uponce" or "in response to determining" or "in response to detecting", depending on the context. Similarly, the phrase "if it is determined" or "if [described condition or event] is detected" can be interpreted as meaning "uponce it is determined" or "in response to determining" or "uponce [described condition or event] is detected" or "in response to detecting [described condition or event]", depending on the context.
[0030] In addition, in the description of the present application specification and the appended claims, the terms "first", "second", "third", etc. are only used to distinguish the descriptions and cannot be understood as indicating or implying relative importance.
[0031] References to "one embodiment" or "some embodiments" etc. described in the specification of this application mean that one or more embodiments of the present application include specific features, structures or characteristics described in conjunction with the embodiment. Therefore, the statements "in one embodiment", "in some embodiments", "in some other embodiments", "in some other embodiments", etc. that appear in different places in this specification do not necessarily refer to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized in other ways. The terms "including", "comprising", "having" and their variations all mean "including but not limited to", unless otherwise specifically emphasized in other ways.
[0032] In order to make the purpose, technical solutions and advantages of the present application clearer, the simulation method of the teaching experiment of the present application is explained below from the perspective of the simulation device of the teaching experiment. The simulation device of the teaching experiment can be an electronic device, such as a mobile phone terminal, a computer terminal and other devices.
[0033] Reference Figure 1 , Figure 1 The following is a flowchart of an embodiment of a simulation method for a teaching experiment of the present application, wherein the method comprises the following steps: In step S1, the experimental task is obtained.
[0034] Specifically, the experimental task can be sent from the teacher end to multiple selected student ends. The experimental task can be divided into experimental name, experimental goal, experimental equipment and experimental materials. For example, the teacher end can send experimental tasks to all selected student ends in class. The experimental name is "Potassium permanganate to produce oxygen experiment", the experimental goal is "Produce oxygen to inflate balloons", the experimental equipment is "funnel, test tube, sink, beaker, alcohol lamp, glass rod, oxygen detection tube and balloon", and the experimental materials are "potassium permanganate, sulfuric acid".
[0035] In step S2, according to the experimental target requirements, the demand data in the database is obtained.
[0036] Specifically, through the experimental task information, the required data can be obtained from the teaching database, for example, a series of experimental preparation data required for the "potassium permanganate oxygen production experiment" can be obtained from the database.
[0037] In step S3, virtual experimental equipment is generated according to the demand data, and a mapping relationship between the virtual experimental equipment is established.
[0038] Specifically, after obtaining the required data from the teaching database, it is possible to construct a virtual scene, generate the required virtual experimental equipment, and establish interaction between props and actions in the virtual space. For example, students can wear glove-type VR devices on their hands to pick up a virtually generated beaker, and corresponding interactions can also occur between virtual props. For example, in the "carbon dioxide production experiment", the virtually produced carbon dioxide is discharged into the virtually constructed clear lime water. Based on the mapping relationship, the virtual lime water will become turbid like the real thing.
[0039] In step S4, the motion capture information of the target user is obtained.
[0040] Specifically, the target user can send hand motion capture information by operating a VR handle, wearing VR gloves, etc. The hand motion capture information may include finger movements, palm positions, etc. Based on the captured hand motion information, a virtual hand image is generated by wearing a VR helmet on the target user.
[0041] In step S5, a virtual interaction result between the motion capture information and the experimental equipment is generated according to the mapping relationship.
[0042] Specifically, in step S4, the generated hand virtual image can interact with the virtual experimental equipment generated in step S3, and the virtual interaction result generated by the interaction is generated according to the mapping relationship between the virtual experimental equipment established in step S3.
[0043] More specifically, assuming that the experimental task that the students are conducting this time is called "Experiment on producing oxygen from potassium permanganate", when performing the step of "heating the bottom of the test tube with an alcohol lamp to make the liquid in the test tube boil and produce oxygen", the student contacts the virtual alcohol lamp with the virtual fire source for a few seconds, and the virtual alcohol wick will be ignited. Then the ignited virtual alcohol lamp is moved to heat the bottom of the virtual test tube. After a period of time, the virtual liquid in the virtual test tube will boil. Among them, the interaction of igniting the alcohol lamp and moving the alcohol lamp is the interaction between the generated virtual image of the target user's hand and the virtual equipment, and the virtual alcohol wick is ignited by the virtual fire source and heats the virtual liquid in the virtual test tube until it boils, which is the interaction between virtual equipment and virtual equipment.
[0044] More specifically, virtual interaction results are continuously generated until the virtual interaction results meet the experimental goal requirements. The experimental goal requirements are preset designated virtual interaction results. Before the virtual interaction results pinned to the experimental goal requirements are achieved, the experiment is considered incomplete. For example, the experimental goal requirements may be "the light bulb is lit", "the balloon expands", or "the clear lime water becomes turbid". As for the "potassium permanganate oxygen production experiment", only when the simulated gas generated in the virtual test tube enters the virtual balloon, causing the virtual balloon to expand from deflated, is it considered to meet the experimental goal requirements. Other virtual interaction results during this period are regarded as experimental operation processes. When the virtual interaction results meet the experimental goal requirements, the experimental simulation stops.
[0045] Furthermore, when the experimental simulation stops, students may need to review the experimental operation just performed to deepen their understanding of the experimental course content. Therefore, in some possible embodiments, after continuously generating virtual interaction results until the virtual interaction results meet the experimental goal requirements, the following steps are further included: Get a replay of the completed experiment.
[0046] Obtain the playback instruction of the target user, and play the experimental playback video according to the playback instruction.
[0047] Specifically, the playback recording will be saved in the device in the form of a video. After the device obtains the playback command of the target user, it can use the first-person perspective or the third-person perspective to replay the experimental task that the user has completed. It can also adjust the video playback progress according to the nodes of different step operations to improve the review efficiency. Among them, the playback command can be issued by the user through virtual buttons, voice commands or physical buttons.
[0048] Furthermore, for some experiments that change rapidly or slowly, the playback speed of the virtual image can be adjusted for observation during review, thereby deepening the students' impression of the experiment and improving their observation ability. Therefore, in some possible embodiments, after obtaining the playback instruction of the target user and playing the experimental playback video according to the playback instruction, the following steps are further included: Obtain a speed adjustment instruction from a target user, and adjust the playback speed of the experimental playback video according to the speed adjustment instruction.
[0049] Specifically, the target user's speed adjustment command can be issued by the user through virtual buttons, voice commands or physical buttons to speed up or slow down the playback speed of the experiment playback video. By slowing down the playback speed, relatively rapid changes such as explosions can be observed, and by speeding up the playback speed, processes such as reagent corrosion can be observed, thereby improving the efficiency of review and satisfying students' curiosity about scientific experiments.
[0050] Furthermore, students may find irregular experimental operations in the completed experiment during the review process and want to correct them by re-performing this step. Therefore, in some possible embodiments, after obtaining the playback instruction of the target user and playing the experimental playback video according to the playback instruction, the following steps are further included: Obtain a retry instruction of the target user, and determine a retry node according to the retry instruction.
[0051] Specifically, the target user's retry command can be issued by the user through virtual buttons, voice commands or physical buttons. The user can select a step node according to the progress of the experimental playback video. If the user believes it is necessary to redo the step, he can select the step to issue a retry command. The device will determine the virtual equipment and other data corresponding to the node that should be redone based on the instructions issued by the user.
[0052] The retry node is loaded, and the target user starts from the retry node and re-performs the experiment.
[0053] Specifically, after the device determines the virtual equipment and other data corresponding to the node that should be re-performed according to the instructions issued by the user, the virtual scene will be reconstructed into a virtual scene corresponding to the selected node, and the user can re-perform the experimental steps he wants to retry in the reconstructed scene.
[0054] Furthermore, when students are performing experimental operations, they may need the guidance of teachers to perform standardized operations. Otherwise, students may not know what to do or perform experimental operations that do not conform to the standards. Teachers sometimes cannot take into account multiple studies at the same time. Therefore, in some possible embodiments, the following are also included: Get the experimental tutorial information of the experimental task.
[0055] Obtain a play instruction from a target user, and play the experimental tutorial information of the experimental task according to the play instruction.
[0056] Specifically, the tutorial information can be the electronic textbooks corresponding to the published experimental tasks, the video tutorials supporting the textbooks, or the recorded operation demonstrations by teachers. Students taking the experimental classes can call up the corresponding experimental tutorial information at any time as needed, and conduct experiments in comparison, which improves the standardization of students' experiments and saves teachers' energy. The tutorial information can also be a real-time live broadcast from the teacher's end to all students taking the experimental classes. The teacher guides students to learn through real-time demonstrations and on-site interactions. After the real-time live broadcast ends, a recording can be generated as a teacher's recorded operation demonstration video for students to watch repeatedly.
[0057] More specifically, since it is difficult for teachers to check the experimental operations of multiple students at the same time, they can also define the operation specifications according to the experimental tutorial information corresponding to the experimental task, identify the operation through the device, and correct the student operation in time. Therefore, in some possible embodiments, it also includes: According to the tutorial information, the experimental specifications are determined, and the experimental specifications are divided into primary experimental specifications and secondary experimental specifications.
[0058] Specifically, experimental specifications can be divided according to the degree of hazard. Experimental operations that will cause certain adverse effects but will not affect the experimental results if violated are classified as first-level experimental specifications, such as "when using an alcohol lamp to heat the test tube, the heat source is too far away from the heating point of the test tube"; and those that may have serious consequences such as endangering personal safety and failure of the experiment if violated are classified as second-level experimental specifications, such as "extinguishing the alcohol lamp with water" rather than "extinguishing the burning alcohol lamp with the cap of the alcohol lamp."
[0059] According to the motion capture information, it is determined whether the target user violates the primary experimental specification or the secondary experimental specification.
[0060] Specifically, violation of the first-level experimental specifications may affect the experimental results, making the experimental results inaccurate, and may also damage the experimental equipment. For example, in the "potassium permanganate oxygen production experiment", it should be "using a burning alcohol lamp to touch and heat the bottom of the test tube at an appropriate distance". If the student places the alcohol lamp too far from the bottom of the test tube during the experimental operation, resulting in poor heating effect, or the alcohol lamp heats the middle part of the test tube, resulting in insufficient chemical reaction, it is considered to have violated the first-level experimental specifications; If the target user violates the first-level experimental specification, a first prompt message is sent to the target user, and the experimental tutorial information is shown.
[0061] Specifically, the first prompt information can be a voice message, which broadcasts the voice to the target user, informing the target user that the experimental operation just conducted violates the first-level experimental specifications, and displays the experimental tutorial information. The experimental tutorial information can be direct voice guidance of the standard steps, or other guidance methods such as tutorial video playback. For example, if the target user violates the first-level experimental specifications because "when using an alcohol lamp to heat the test tube, the heat source is too far away from the heating point of the test tube", the device can be controlled to send corresponding voice guidance, such as "use an alcohol lamp to heat the bottom of the test tube, the distance should be moderate", etc., to assist students in timely adjustments to the experimental operation. At the same time, if the user violates the first-level experimental specifications multiple times, the error value of the experimental result may be too large. Therefore, in some possible embodiments, a method for handling users who repeatedly violate the first-level experimental specifications is also included, which is specifically explained below: It is determined whether the number of times the target user violates the first-level experimental specification exceeds a preset number.
[0062] Specifically, the preset number of times may be set by the target user, and the set number of times may be three times. However, there is usually no limit on the first-level experimental specification that is violated. The user may violate the same experimental specification continuously, or may violate different experimental specifications.
[0063] If the target user violates the first-level experimental specification for more than a preset number of times, the experimental tutorial information is shown and then the current experiment is restarted.
[0064] Specifically, taking the preset number of times as three as an example, when the user's experimental operation violates three first-level experimental specifications in one experiment, it can be approximately regarded as violating one second-level experimental specification. In this case, there is little meaning in continuing the experiment. Restarting the current experiment provides the target user with an opportunity to re-experiment. Before restarting, the teaching videos, textbooks and other experimental tutorial information should be re-showed to the target user so that the target user can confirm the correct experimental specifications again.
[0065] If the target user violates the secondary experiment specification, a second prompt message is sent to the target user, and the experiment tutorial information is shown, and then the current experiment is restarted.
[0066] Specifically, the second prompt information can be a voice message. If the first prompt information is a voice message, the voice message of the second prompt information can be different from the voice message of the first prompt information. The voice broadcast content can be worded in a warning tone. For example, if the target user violates the secondary experimental specification because of the operation of "using an alcohol lamp to directly heat the bottom of the beaker", the device can be controlled to send a corresponding voice warning + guidance, such as "Warning, using an alcohol lamp to directly heat the beaker may cause local boiling, even liquid splashing, or even beaker bursting, endangering personal safety". Then add a voice guidance such as "beaker heating should be padded with asbestos net at the bottom of the beaker", which is convenient for students to remember the harm of wrong operations and to correct wrong experimental operations in time. In addition to voice, guidance can also be provided by playing standard operation videos and other means.
[0067] More specifically, since violation of the secondary experimental specifications may result in the experiment being unable to proceed normally, and in order to deepen students' understanding of the experimental content, the experiment should be repeated after the experimental operation that violates the secondary experimental specifications. The virtual scene will be reset, and the virtual interaction results that have been generated will be initialized to the state at the beginning of the experiment.
[0068] Furthermore, in order to facilitate students and teachers to understand the students' mastery of the content of this experimental class, the general mastery can be determined through objective transcripts. Therefore, in some possible embodiments, the following is also included: Determine the experimental scoring criteria based on the experimental specifications.
[0069] Specifically, the grades can be divided according to the grading of the experimental specifications. For experimental operations that violate the first-level experimental specifications, appropriate points will be deducted according to the degree of impact, while for experimental operations that violate the second-level experimental specifications, the experiment can be directly repeated without making a record of this experiment. For example, for the two experimental operations that violate the first-level experimental specifications, "looking down at the beaker scale estimation" and "heating the test tube with a burning alcohol lamp too far from the bottom of the test tube", which may lead to inaccurate grasp of the reagent volume and affect the experimental results, the operation of "heating the test tube with a burning alcohol lamp too far from the bottom of the test tube" may have a more serious impact on the experiment, resulting in an inadequate reaction, and more points can be deducted compared to the former. As for the experimental operation of "using a burning alcohol lamp to directly heat the bottom of the beaker", which violates the second-level experimental specifications, it may cause serious harm and is an operation that must be avoided, so it is directly not recorded and the current experiment is restarted.
[0070] A target user experimental evaluation is generated based on the motion capture information and combined with the scoring criteria.
[0071] Specifically, when the device recognizes that the target user is performing experimental steps, it will make a judgment based on the generated scoring criteria. For example, when the user lifts up the beaker to observe the scale, the position of the user's hand can be compared with the position of the user's eyes to determine whether the user is currently looking up, looking down, or looking straight ahead, thereby determining whether the user is performing the experimental operation correctly in the experimental specification of "looking straight ahead to observe the scale".
[0072] More specifically, if the experimental task is completed, all operations that do not meet the experimental specifications in this experiment will be counted and scored to generate a target user experimental evaluation. The experimental evaluation can help students or teachers understand how well students have mastered the content of this experimental class.
[0073] In one embodiment, a simulation system for teaching experiments is provided, and the simulation system for teaching experiments corresponds to the simulation method for teaching experiments in the above embodiment. The simulation system for teaching experiments includes a task acquisition module, a data acquisition module, a scene construction module, a motion capture module, and an experiment simulation module. Figure 2 , Figure 2 It is a system block diagram of an embodiment of the simulation system of the teaching experiment of the present application, which specifically includes: The task acquisition module 100 is used to acquire an experimental task, wherein the experimental task includes experimental target requirements; The data acquisition module 200 is used to acquire the required data in the database according to the experimental target requirements; A scene construction module 300 is used to generate virtual experimental equipment according to the demand data and establish a mapping relationship between the virtual experimental equipment; The motion capture module 400 is used to obtain the motion capture information of the target user; The experiment simulation module 500 is used to generate a virtual interaction result between the motion capture information and the experiment equipment according to the mapping relationship.
[0074] The specific definition of the simulation system of the teaching experiment can be found in the definition of the simulation method of the teaching experiment above, which will not be repeated here. Each module in the simulation system of the teaching experiment can be implemented in whole or in part by software, hardware and a combination thereof. The above modules can be embedded in or independent of the processor in the computer device in the form of hardware, or can be stored in the memory in the computer device in the form of software, so that the processor can call and execute the operations corresponding to the above modules.
[0075] The technicians in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional units and modules is used as an example for illustration. In practical applications, the above-mentioned function allocation can be completed by different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiment can be integrated in a processing unit, or each unit can exist physically separately, or two or more units can be integrated in one unit. The above-mentioned integrated unit can be implemented in the form of hardware or in the form of software functional units. In addition, the specific names of the functional units and modules are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of this application. The specific working process of the units and modules in the above-mentioned system can refer to the corresponding process in the aforementioned method embodiment, which will not be repeated here.
[0076] The simulation method of a teaching experiment provided in an embodiment of the present application can be applied to terminal devices such as electronic devices, computers, wearable devices, vehicle-mounted devices, tablet computers, laptop computers, netbooks, personal digital assistants (PDA), augmented reality (AR) / virtual reality (VR) devices, mobile phones, etc. The embodiment of the present application does not impose any restrictions on the specific type of the terminal device.
[0077] The embodiment of the present application further provides a computer-readable storage medium, which stores a computer program. When the computer program is executed by a processor, the steps in each embodiment of the above method can be implemented.
[0078] An embodiment of the present application provides a computer program product. When the computer program product runs on a mobile terminal, the mobile terminal can implement the steps in each embodiment of the above method when executing the computer program product.
[0079] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the present application implements all or part of the processes in the above-mentioned embodiment method, which can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a computer-readable storage medium. When the computer program is executed by the processor, the steps of the above-mentioned various method embodiments can be implemented. Among them, the computer program includes computer program code, and the computer program code can be in source code form, object code form, executable file or some intermediate form. The computer-readable medium may at least include: any entity or device that can carry the computer program code to the camera / terminal device, recording medium, computer memory, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), electric carrier signal, telecommunication signal and software distribution medium. For example, a USB flash drive, a mobile hard disk, a magnetic disk or an optical disk. In some jurisdictions, according to legislation and patent practice, computer-readable media cannot be electric carrier signals and telecommunication signals.
[0080] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described or recorded in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.
[0081] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.
[0082] In the embodiments provided in the present application, it should be understood that the disclosed devices / network equipment and methods can be implemented in other ways. For example, the device / network equipment embodiments described above are only schematic. For example, the division of modules or units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.
[0083] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
[0084] The above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. These modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application, and should all be included in the protection scope of the present application.
Claims
1. A simulation method for teaching experiments, characterized in that: The method comprises: Obtaining an experimental task; obtaining required data in a database according to the experimental task; Generate virtual experimental equipment according to the demand data, and establish a mapping relationship between the virtual experimental equipment; Obtain motion capture information of the target user; According to the mapping relationship, a virtual interaction result between the motion capture information and the experimental equipment is generated.
2. The simulation method for teaching experiment according to claim 1, characterized in that: The method further comprises: Obtaining experimental tutorial information of the experimental task; Obtaining a playback instruction from a target user, and playing the experimental tutorial information of the experimental task according to the playback instruction; Determine the experimental specifications according to the tutorial information, wherein the experimental specifications are divided into primary experimental specifications and secondary experimental specifications; Determining whether the target user violates the first-level experimental specification or the second-level experimental specification according to the motion capture information; If the target user violates the first-level experimental specification, a first prompt message is sent to the target user, and the experimental tutorial information is shown; If the target user violates the secondary experiment specification, a second prompt message is sent to the target user, and the experiment tutorial information is shown, and then the current experiment is restarted.
3. The simulation method for teaching experiment according to claim 2 is characterized in that: After the step of determining whether the target user violates the first-level experimental specification or the second-level experimental specification according to the motion capture information, the method further includes: Determine whether the target user violates the first-level experimental specification more than a preset number of times; If the target user violates the first-level experimental specification for more than a preset number of times, the experimental tutorial information is shown and then the current experiment is restarted.
4. The simulation method for teaching experiment according to claim 2, characterized in that: The method further comprises: Determine the experimental scoring criteria according to the experimental specifications; A target user experimental evaluation is generated based on the motion capture information and combined with the scoring criteria.
5. The simulation method for teaching experiment according to any one of claims 1 to 4, characterized in that: After the step of continuously generating virtual interaction results until the virtual interaction results meet the experimental target requirements, the method further includes: Get playback video of completed experiments; Obtain the playback instruction of the target user, and play the experimental playback video according to the playback instruction.
6. The simulation method for teaching experiment according to claim 5, characterized in that: After obtaining a playback instruction from a target user and playing the experimental playback video according to the playback instruction, the method further includes: Obtain a speed adjustment instruction from a target user, and adjust the playback speed of the experimental playback video according to the speed adjustment instruction.
7. The simulation method for teaching experiment according to claim 5, characterized in that: After obtaining a playback instruction from a target user and playing the experimental playback video according to the playback instruction, the method further includes: Obtain a retry instruction from a target user, and determine a retry node according to the retry instruction; The retry node is loaded, and the target user starts from the retry node and re-performs the experiment.
8. A simulation system for teaching experiments, characterized in that: include: A task acquisition module, used to acquire an experimental task, wherein the experimental task includes experimental target requirements; A data acquisition module is used to acquire the required data in the database according to the experimental target requirements; A scene construction module, used to generate virtual experimental equipment according to the demand data and establish a mapping relationship between the virtual experimental equipment; A motion capture module, used to obtain motion capture information of the target user; The experimental simulation module is used to generate a virtual interaction result between the motion capture information and the experimental equipment according to the mapping relationship.
9. A device, characterized in that: The method comprises a memory and a processor, wherein the memory stores a computer program that can be loaded by the processor and executes the simulation method of the teaching experiment as described in any one of claims 1 to 7.
10. A storage medium, characterized in that: A computer program is stored which can be loaded by a processor and execute the simulation method of the teaching experiment as described in any one of claims 1 to 7.