A teaching interactive system based on metaverse
By designing classroom data collection, data collection, physical environment simulation, visual and auditory presentation modules in the metacosmic environment, interactive teaching of virtual classrooms is realized, the problem of insufficient interactivity in online classes is solved, and teaching interactivity is improved.
Patent Information
- Application Number
- CN202211552194.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-12-05
- Publication Date
- 2024-11-08
- Estimated Expiration
- 2042-12-05
AI Technical Summary
The existing online course live broadcast form is difficult to achieve normal classroom interactive behavior, and there is a lack of technical solutions for virtual classrooms and interactions in the metacosmic environment.
A teaching interactive system based on the metaverse was designed, including classroom data collection module, data collection module, physical environment simulation module, visual presentation module and auditory presentation module. Through these modules, the real classroom environment is collected and simulated, and the teacher and students are realized. Interactive teaching.
It improves the interactivity of online classes, allowing students and teachers in different positions to teach and interact in virtual classrooms as if they were in actual classrooms.
Smart Images

Figure CN115880954B_ABST
Abstract
Description
Technical Field
[0001] The present invention belongs to the field of metaverse, relates to metaverse teaching technology, and specifically is a metaverse-based teaching interaction system. Background Art
[0002] The metaverse is a virtual world that is linked and created by scientific and technological means, and that maps and interacts with the real world. It is a digital living space with a new social system. At the same time, students currently widely use online courses for teaching activities, and the live broadcast format used in online courses is on a two-dimensional plane, which makes it difficult to conduct normal classroom interaction. The characteristics of the metaverse just meet the interactivity of online courses. At present, there is no technology that presents virtual classrooms to students and teachers in the metaverse environment, and teaches and interacts in the metaverse environment.
[0003] To this end, a teaching interaction system based on metaverse is proposed. Summary of the invention
[0004] The present invention aims to solve at least one of the technical problems existing in the prior art. To this end, the present invention proposes a teaching interaction system based on the metaverse, which pre-collects the basic information of the class to be taught by setting a classroom data collection module; sets a data collection module to collect the data to be displayed in the metaverse classroom in real time; sets a physical environment simulation module to perform visual simulation of the real classroom physical environment in the metaverse environment; sets a visual presentation module to visually present the teaching scene of the metaverse classroom to teachers and students; sets an auditory presentation module to bring auditory presentation to each student and teacher in the metaverse classroom; teachers and students teach and interact as in actual classrooms; improves the interactivity and interactivity of online courses.
[0005] To achieve the above-mentioned purpose, according to an embodiment of the first aspect of the present invention, a teaching interaction system based on the metaverse is proposed, comprising a classroom data collection module, a data acquisition module, a physical environment simulation module, a visual presentation module and an auditory presentation module; wherein each module is connected to another by electrical means and / or wireless network means;
[0006] Among them, the classroom data collection module is mainly used to collect basic information of the class to be taught in advance;
[0007] The basic information of the class to be taught collected by the classroom data collection module includes actual class information and virtual class information; wherein the actual class information includes the class number, student list, student seat arrangement, teacher list and class schedule; the virtual class information includes the Metaverse accounts corresponding to the students and teachers in the student list and teacher list in each class;
[0008] The classroom data collection module sends the basic information of the class to be taught to the data acquisition module;
[0009] Among them, the data acquisition module is mainly used to collect the data that needs to be displayed in the Metaverse classroom in real time;
[0010] The data acquisition module includes a human body data acquisition unit, a device data acquisition unit and a sound data acquisition unit;
[0011] The human body data collection unit is mainly used to collect the posture and action data of teachers and students in real time;
[0012] The human body data collection unit collects posture and action data including the following captures:
[0013] Step S1: The human body data acquisition unit captures images of students and teachers in real time through an image capture device, and captures the postures of students and teachers through image analysis technology;
[0014] Step S2: The human body data acquisition unit captures the actions taken by students and teachers in real time through the smart wearable device;
[0015] The human body data collection unit sends the collected posture and action data of the students and teachers to the visual presentation module;
[0016] Among them, the device data acquisition unit is mainly used to pre-collect the physical device data required in the Metaverse classroom;
[0017] The device data acquisition unit converts the physical appearance of the physical device into digital information by scanning the physical device with an optical scanning device; the physical device includes but is not limited to tables and chairs used by students, textbooks for each course, blackboards used by teachers, and chalk or ink pens required for blackboard writing, etc.; the device data acquisition unit saves the digital information obtained by scanning the physical device; the device data acquisition unit sends the collected physical device data to the visual presentation module;
[0018] The sound data acquisition unit is mainly used to capture the sound data emitted by each teacher and student in the Metaverse classroom in real time; the sound data includes the pitch, loudness and timbre of the sound;
[0019] The sound data acquisition unit captures the sound data in the following manner: using a sound capture device to capture the sound produced by the teacher and the students speaking or moving in real time;
[0020] The sound data collection unit sends the collected sound data to the auditory presentation module;
[0021] Wherein, the physical environment simulation module is mainly used to simulate the physical environment in the metaverse environment;
[0022] The physical environment simulation module simulates the physical environment and comprises the following steps:
[0023] Step P1: The physical environment simulation module pre-sets classroom physical parameters; and generates the space size of the classroom according to the classroom physical parameters, the shape and size of the tables and chairs, and the number of students; the classroom physical parameters include the distance between the tables and chairs and the activity space of the teacher in front of the blackboard;
[0024] Step P2: Before teaching, the teacher selects the classroom visual style through the physical environment simulation module;
[0025] Step P3: The physical environment simulation module generates a virtual classroom with a corresponding visual style and space size in the metaverse space; and arranges tables, chairs, blackboards, textbooks, and chalk or ink pens in the virtual classroom according to the physical parameters of the classroom;
[0026] The physical environment simulation module sends the simulated physical environment to the visual presentation module and the auditory presentation module;
[0027] The visual presentation module is mainly used to visually present the teaching scene of the Metaverse classroom to teachers and students;
[0028] The visual presentation module visually presents the teaching scene to the teacher and the students, including the following steps:
[0029] Step Q1: After each student and teacher logs in to the Metaverse account, a simulated classroom environment corresponding to the class number is presented to them according to the account information; the student's Metaverse image is arranged in the corresponding simulated classroom seat position; the teacher's Metaverse image is arranged in front of the blackboard;
[0030] Step Q2: According to the posture and action data of each student and teacher received in real time, the corresponding postures and actions of the students and teachers in the Metaverse classroom are adjusted in real time;
[0031] Step Q3: For each physical device used by students and teachers in the action, show the corresponding behavior results to students and teachers according to the physical properties of the physical devices;
[0032] Among them, the auditory presentation module is mainly used to provide auditory presentation for each student and teacher in the Metaverse classroom;
[0033] The auditory presentation module performs auditory presentation in the Metaverse classroom in the following manner: the auditory presentation module receives the sounds emitted by teachers and students in real time; denoises each collected sound, and simulates the propagation and reflection of each sound in the corresponding physical environment according to the physical characteristics of the physical environment simulated by the Metaverse classroom, and generates simulated sounds for presentation to all students and teachers.
[0034] Compared with the prior art, the present invention has the following beneficial effects:
[0035] The present invention arranges students and teachers in different locations in a virtual classroom of the same metaverse by using metaverse technology; in the virtual classroom, teachers and students teach and interact as if in a real classroom, thereby improving the interactivity and interactivity of online courses. BRIEF DESCRIPTION OF THE DRAWINGS
[0036] Figure 1 It is a schematic diagram of the present invention. DETAILED DESCRIPTION
[0037] The technical solution of the present invention will be clearly and completely described below in conjunction with the embodiments. Obviously, the described embodiments are only part of the embodiments of the present invention, rather than all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
[0038] like Figure 1 As shown, a teaching interaction system based on the metaverse includes a classroom data collection module, a data acquisition module, a physical environment simulation module, a visual presentation module, and an auditory presentation module; wherein each module is connected to another by electrical means and / or wireless network means;
[0039] It is understandable that the Metaverse, as a virtual world that is linked and created by scientific and technological means and that maps and interacts with the real world, has a digital living space for a new social system. At the same time, students currently widely use online courses for teaching activities, and the live broadcast format used in online courses is on a two-dimensional plane, making it difficult to conduct normal classroom interaction. The characteristics of the Metaverse just meet the interactivity of online courses.
[0040] Among them, the classroom data collection module is mainly used to collect basic information of the class to be taught in advance;
[0041] It is understandable that in a school class, the list of teachers and students is fixed; and the daily class schedule is pre-set;
[0042] In a preferred embodiment, the basic information of the class to be taught collected by the classroom data collection module includes actual class information and virtual class information; wherein the actual class information includes the class number, student list, student seat arrangement, teacher list and class schedule; the virtual class information includes the Metaverse accounts corresponding to the students and teachers in the student list and teacher list in each class;
[0043] The classroom data collection module sends the basic information of the class to be taught to the data acquisition module;
[0044] Among them, the data acquisition module is mainly used to collect the data that needs to be displayed in the Metaverse classroom in real time;
[0045] The data acquisition module includes a human body data acquisition unit, a device data acquisition unit and a sound data acquisition unit;
[0046] The human body data collection unit is mainly used to collect the posture and action data of teachers and students in real time;
[0047] In a preferred embodiment, the human body data collection unit collects posture and action data including the following captures:
[0048] Step S1: The human body data acquisition unit captures images of students and teachers in real time through an image capture device, and captures the postures of students and teachers through image analysis technology;
[0049] Step S2: The human body data acquisition unit captures the actions taken by students and teachers in real time through the smart wearable device;
[0050] The human body data collection unit sends the collected posture and action data of the students and teachers to the visual presentation module;
[0051] Among them, the device data acquisition unit is mainly used to pre-collect the physical device data required in the Metaverse classroom;
[0052] In a preferred embodiment, the device data acquisition unit converts the physical appearance of the physical device into digital information by scanning the physical device with an optical scanning instrument; the physical device includes but is not limited to tables and chairs used by students, textbooks for each course, blackboards used by teachers, and chalk or ink pens required for blackboard writing, etc.; the device data acquisition unit saves the digital information obtained by scanning the physical device; it should be understood that for the textbooks of the student courses, it is necessary to use an optical scanning instrument to scan each page of the textbook; and all pages are sorted according to the actual order of the pages in the textbook; the device data acquisition unit sends the collected physical device data to the visual presentation module;
[0053] The sound data acquisition unit is mainly used to capture the sound data emitted by each teacher and student in the Metaverse classroom in real time; the sound data includes the pitch, loudness and timbre of the sound;
[0054] In a preferred embodiment, the sound data acquisition unit captures the sound data in the following manner: using a sound capture device to capture the sound produced by the teacher and the students speaking or moving in real time;
[0055] The sound data collection unit sends the collected sound data to the auditory presentation module;
[0056] Wherein, the physical environment simulation module is mainly used to simulate the physical environment in the metaverse environment;
[0057] In a preferred embodiment, the physical environment simulation module simulates the physical environment including the following steps:
[0058] Step P1: The physical environment simulation module pre-sets classroom physical parameters; and generates the space size of the classroom according to the classroom physical parameters, the shape and size of the tables and chairs, and the number of students; the classroom physical parameters include the distance between the tables and chairs and the activity space of the teacher in front of the blackboard;
[0059] Step P2: Before teaching, the teacher selects the classroom visual style through the physical environment simulation module;
[0060] Step P3: The physical environment simulation module generates a virtual classroom with a corresponding visual style and space size in the metaverse space; and arranges tables, chairs, blackboards, textbooks, and chalk or ink pens in the virtual classroom according to the physical parameters of the classroom;
[0061] The physical environment simulation module sends the simulated physical environment to the visual presentation module and the auditory presentation module;
[0062] The visual presentation module is mainly used to visually present the teaching scene of the Metaverse classroom to teachers and students;
[0063] The visual presentation module visually presents the teaching scene to the teacher and the students, including the following steps:
[0064] Step Q1: After each student and teacher logs in to the Metaverse account, a simulated classroom environment corresponding to the class number is presented to them according to the account information; the student's Metaverse image is arranged in the corresponding simulated classroom seat position; the teacher's Metaverse image is arranged in front of the blackboard;
[0065] Step Q2: According to the posture and action data of each student and teacher received in real time, the corresponding postures and actions of the students and teachers in the Metaverse classroom are adjusted in real time;
[0066] Step Q3: For each physical device used by students and teachers in the action, show the corresponding behavior results to students and teachers according to the physical properties of the physical devices; as an example: when a teacher picks up a piece of chalk in the Metaverse classroom and writes on the blackboard with the chalk, in the Metaverse classroom, show the students and teachers the marks left on the blackboard due to the physical properties of the chalk and the blackboard;
[0067] Among them, the auditory presentation module is mainly used to provide auditory presentation for each student and teacher in the Metaverse classroom;
[0068] In a preferred embodiment, the auditory presentation module performs auditory presentation in the metaverse classroom in the following manner: the auditory presentation module receives the sounds emitted by teachers and students in real time; further, each collected sound is denoised, and according to the physical characteristics of the physical environment simulated by the metaverse classroom, the propagation and reflection of each sound in the corresponding physical environment are simulated to generate simulated sounds for presentation to all students and teachers.
[0069] The above embodiments are only used to illustrate the technical method of the present invention rather than to limit it. Although the present invention has been described in detail with reference to the preferred embodiments, those skilled in the art should understand that the technical method of the present invention may be modified or replaced by equivalents without departing from the spirit and scope of the technical method of the present invention.
Claims
1. A teaching interactive system based on the metaverse, characterized in that: It includes a classroom data collection module, a data acquisition module, a physical environment simulation module, a visual presentation module and an auditory presentation module; wherein each module is connected to another module by electrical means and / or wireless network means; The classroom data collection module is used to collect basic information of the class to be taught in advance; the classroom data collection module sends the basic information of the class to be taught to the data acquisition module; The data acquisition module includes a human body data acquisition unit, a device data acquisition unit and a sound data acquisition unit; The human body data collection unit is used to collect posture and action data of teachers and students in real time; The device data acquisition unit is used to pre-acquire the physical device data required in the Metaverse classroom; The sound data collection unit is used to capture the sound data emitted by each teacher and student in the Metaverse classroom in real time; The data acquisition module sends the collected student's posture, action data and device data to the visual presentation module, and sends the collected sound data to the auditory presentation module; The physical environment simulation module is used to simulate the physical environment in the metaverse environment; the physical environment simulation module sends the simulated physical environment to the visual presentation module and the auditory presentation module; The visual presentation module is used to visually present the teaching scene of the Metaverse classroom to teachers and students; The auditory presentation module is used to provide auditory presentation for each student and teacher in the Metaverse classroom; The physical environment simulation module simulates the physical environment and comprises the following steps: Step P1: The physical environment simulation module pre-sets classroom physical parameters; and generates the space size of the classroom according to the classroom physical parameters, the shape and size of the tables and chairs, and the number of students; the classroom physical parameters include the distance between the tables and chairs and the activity space of the teacher in front of the blackboard; Step P2: Before teaching, the teacher selects the classroom visual style through the physical environment simulation module; Step P3: The physical environment simulation module generates a virtual classroom with a corresponding visual style and space size in the metaverse space; and places physical equipment in the virtual classroom according to the physical parameters of the classroom; The visual presentation module visually presents the teaching scene to the teacher and the students, including the following steps: Step Q1: After each student and teacher logs in to the Metaverse account, a simulated classroom environment corresponding to the class number is presented to them according to the account information; the student's Metaverse image is arranged in the corresponding simulated classroom seat position; the teacher's Metaverse image is arranged in front of the blackboard; Step Q2: According to the posture and action data of each student and teacher received in real time, the corresponding postures and actions of the students and teachers in the Metaverse classroom are adjusted in real time; Step Q3: For each physical device used by students and teachers in the action, show the corresponding behavior results to students and teachers according to the physical properties of the physical devices; The auditory presentation module performs auditory presentation in the Metaverse classroom in the following manner: the auditory presentation module receives the sounds emitted by teachers and students in real time; denoises each collected sound, and simulates the propagation and reflection of each sound in the corresponding physical environment according to the physical characteristics of the physical environment simulated by the Metaverse classroom, and generates simulated sounds for presentation to all students and teachers.
2. The teaching interactive system based on the metaverse according to claim 1, characterized in that: The basic information of the class to be taught collected by the classroom data collection module includes actual class information and virtual class information; wherein, the actual class information includes the class number, student list, student seating arrangement, teacher list and classroom course schedule; the virtual class information includes the Metaverse accounts corresponding to the students and teachers in the student list and teacher list in each class.
3. The teaching interactive system based on the metaverse according to claim 1, characterized in that: The human body data collection unit collects posture and action data including the following captures: Step S1: The human body data acquisition unit captures images of students and teachers in real time through an image capture device, and captures the postures of students and teachers through image analysis technology; Step S2: The human body data acquisition unit captures the actions taken by students and teachers in real time through the smart wearable device.
4. The teaching interactive system based on the metaverse according to claim 1, characterized in that: The device data acquisition unit converts the physical appearance of the physical device into digital information by scanning the physical device with an optical scanning device.
5. The teaching interactive system based on the metaverse according to claim 1, characterized in that: The sound data acquisition unit captures the sound data in the following manner: the sound produced by the teacher and the students' speech or actions is captured in real time by a sound capture device.
