Design method and system for real person digital simulation teaching space

Abstract

The embodiment of the invention provides a real person digital simulation teaching space design method and system, and the method comprises the steps: carrying out the digital collection of a teaching space and a teaching teacher through a collection device disposed at a teaching end, and transmitting the collected teaching teacher information, teaching information and environment information to a class receiving end; the terminal is arranged at the listening end and is used for constructing a three-dimensional model of a real-person digital remote interactive teaching space based on the teaching teacher information, the teaching information and the environment information; and based on an equipment linkage technology, mapping and presenting the three-dimensional model at a corresponding teaching position in the listening end, so that a teaching scene completely consistent with the teaching end can be presented at the listening end.

Description

Technical Field

[0001] The present application relates to the technical field of space digital modeling, and in particular to a design method and system for a real-person digital simulation teaching space. Background Art

[0002] Classroom education is a commonly used means in education and teaching. It is the whole process of teachers imparting knowledge and skills to students. It mainly includes teachers’ explanations, students’ questions and answers, teaching activities and all teaching aids used in the teaching process.

[0003] At present, multimedia teaching used in classroom education is limited to using computers for courseware PPT and other multimedia forms, projecting teaching content onto the screen, or through distance learning methods, through video conferencing or online education platforms, displaying teaching content based on monitors.

[0004] However, this method generally lacks real interaction, especially after the country launched the three classrooms. The distance between students and teachers in different classrooms is relatively large. If individual equipment (such as AR / VR glasses) is used, the integrity will be insufficient, which is not suitable for collective teaching activities and is not conducive to teaching and interaction in the actual classroom teaching environment. Therefore, a new method that can realize real-person digital remote interactive teaching is urgently needed, which can provide an immersive three-dimensional display effect so that listeners can have a good sense of immersion in the real space and face the digital speaker. Summary of the invention

[0005] The purpose of the embodiments of the present application is to provide a design method and system for a real-person digital simulation teaching space, which can allow listeners to have a good sense of immersion in the real space facing the digital speaker.

[0006] The present application also provides a method for designing a real-person digital simulation teaching space, comprising the following steps:

[0007] S1. A collection device at the teaching end digitally collects the teaching space and the teacher, and transmits the collected teacher information, teaching information and environmental information to the listening end;

[0008] S2, a terminal located at the lecture end constructs a three-dimensional model of a real-person digital remote interactive teaching space based on the lecturer information, teaching information and environmental information;

[0009] S3. Based on the device linkage technology, the three-dimensional model is mapped and presented at the corresponding teaching position in the listening end, so that a teaching scene that is completely consistent with that of the teaching end can be presented at the listening end.

[0010] In a second aspect, the embodiment of the present application further provides a design system for a real-person digital simulation teaching space, the system comprising a data acquisition module, a three-dimensional modeling module and an interactive control module, wherein:

[0011] The data acquisition module is used to trigger the acquisition device at the teaching end to digitally acquire the teaching space and the teacher, and transmit the acquired teacher information, teaching information and environmental information to the listening end;

[0012] The three-dimensional modeling module is used to trigger the terminal located at the lecture end to build a three-dimensional model of the real-person digital remote interactive teaching space based on the lecturer information, teaching information and environmental information;

[0013] The interactive control module is used to map and present the three-dimensional model at the corresponding teaching position in the listening end based on the device linkage technology, so that a teaching scene that is completely consistent with that of the teaching end can be presented at the listening end.

[0014] In a third aspect, an embodiment of the present application further provides a readable storage medium, wherein the readable storage medium includes a design method program for a real-person digital simulation teaching space. When the design method program for a real-person digital simulation teaching space is executed by a processor, the steps of a design method for a real-person digital simulation teaching space as described in any one of the above items are implemented.

[0015] As can be seen from the above, the design method, system and readable storage medium of a real-person digital simulation teaching space provided by the embodiment of the present application digitally collect the teaching space and the teacher through the collection device arranged at the teaching end, and transmit the collected teacher information, teaching information and environmental information to the listening end; the terminal arranged at the listening end constructs a three-dimensional model of the real-person digital remote interactive teaching space based on the teacher information, teaching information and environmental information; based on the device linkage technology, the three-dimensional model is mapped and presented at the corresponding teaching position in the listening end, so that the listening end can present a teaching scene that is completely consistent with the teaching end. The implementation of this scheme can form a controllable simulation interactive environment in a controlled space, provide digital collection and digital remote presentation for speakers in a large space, and solve the problem of synchronizing the original handwriting blackboard content and the speech content in a real controllable environment during the digital speech, so that the listeners can have a good sense of immersion in the real space facing the digital speaker.

[0016] Other features and advantages of the present application will be described in the following description, and partly become apparent from the description, or be understood by practicing the embodiments of the present application. The purpose and other advantages of the present application can be realized and obtained by the structures specifically pointed out in the written description, claims, and drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the embodiments of the present application will be briefly introduced below. It should be understood that the following drawings only show certain embodiments of the present application and therefore should not be regarded as limiting the scope. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without paying creative work.

[0018] Figure 1 A flow chart of a method for designing a real-person digital simulation teaching space provided in an embodiment of the present application;

[0019] Figure 2 This is a schematic diagram of the distribution of human skeleton points;

[0020] Figure 3 It is a schematic diagram for collecting human body position information in the teaching space;

[0021] Figure 4 This is a schematic diagram of the distribution of collection equipment;

[0022] Figure 5 Present structural diagrams for digital images;

[0023] Figure 6 A structural schematic diagram of a design system for a real-person digital simulation teaching space provided in an embodiment of the present application. DETAILED DESCRIPTION

[0024] The technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all of the embodiments. The components of the embodiments of the present application described and shown in the drawings here can be arranged and designed in various different configurations. Therefore, the following detailed description of the embodiments of the present application provided in the drawings is not intended to limit the scope of the application claimed for protection, but merely represents the selected embodiments of the present application. Based on the embodiments of the present application, all other embodiments obtained by those skilled in the art without making creative work belong to the scope of protection of the present application.

[0025] It should be noted that similar reference numerals and letters represent similar items in the following drawings, so once an item is defined in one drawing, it does not need to be further defined and explained in subsequent drawings. At the same time, in the description of this application, the terms "first", "second", etc. are only used to distinguish the description and cannot be understood as indicating or implying relative importance.

[0026] Please refer to Figure 1 , Figure 1This is a flow chart of a method for designing a real-person digital simulation teaching space in some embodiments of the present application. The method comprises the following steps:

[0027] Step S1, a collection device arranged at the teaching end digitally collects the teaching space and the teacher, and transmits the collected teacher information, teaching information and environmental information to the listening end.

[0028] It should be noted that the current step is to digitally collect classroom space and human body through the collection device to establish the connection between the space and the human body, and to be able to transmit and present the collected data to realize real-person digital remote interactive teaching.

[0029] Specifically, the above-mentioned acquisition equipment includes but is not limited to depth sensors, cameras, microphones, speakers, displays, sound pickup, amplification, light sources, etc. These devices should have the ability to spatially acquire high-definition images and audio and transmit them simultaneously to ensure the acquisition and use of various data sources required for the clear delivery of teaching content.

[0030] In one of the embodiments, the blackboards used for teaching and listening need to be kept at the same height from the ground, wherein the classroom and the teacher at the teaching end are real scenes, and the teacher at the listening end is a virtual person and the teacher is real scene.

[0031] Step S2, a terminal located at the lecture end constructs a three-dimensional model of a real-person digital remote interactive teaching space based on the lecturer information, teaching information and environmental information.

[0032] Specifically, in the current embodiment, computer graphics, computer vision and other technologies are used to construct a three-dimensional model of a real-person digital remote interactive teaching space based on the teaching teacher information, teaching information and environmental information. The model should include a virtual avatar of the teacher and a virtual scene of the teaching environment.

[0033] Step S3, based on the device linkage technology, the three-dimensional model is mapped and presented at the corresponding teaching position in the listening end, so that a teaching scene that is completely consistent with that of the teaching end can be presented at the listening end.

[0034] As can be seen from the above, the design method of a real-person digital simulation teaching space disclosed in the present application is to digitally collect the teaching space and the teacher through the collection device arranged at the teaching end, and transmit the collected teacher information, teaching information and environmental information to the listening end; the terminal arranged at the listening end constructs a three-dimensional model of the real-person digital remote interactive teaching space based on the teacher information, teaching information and environmental information; based on the equipment linkage technology, the three-dimensional model is mapped and presented at the corresponding teaching position in the listening end, so that the listening end can present a teaching scene that is completely consistent with the teaching end. The implementation of this scheme can form a controllable simulation interactive environment in a controlled space, provide digital collection and digital remote presentation for speakers in a large space, and solve the problem of synchronizing the original handwriting blackboard content and the speech content in a real controllable environment during the digital speech, so that the listeners can have a good sense of immersion in the real space facing the digital speaker.

[0035] In one of the embodiments, in step S1, the teaching teacher information includes human body movement information, human body facial expression information, human body surface texture information, and human body position information.

[0036] Specifically, you can consider using a depth camera or depth sensor to capture the body's skeletal joint information, using a facial camera or sensor (such as an RGB camera, infrared camera, etc.) to capture the body's facial expressions, and you can consider using a high-resolution color camera or texture camera to capture the body's surface texture information.

[0037] In one embodiment, it can be considered to be based on the center point of the human body (such as Figure 2 Point 9) is shown as a reference for human body movements. Figure 2 All other points indicated in the figure can be used as human motion information points to determine human motion based on the positional association between multiple points, and to restore human motion in a three-dimensional simulation environment.

[0038] Specifically, the human body position information L(x, y, z) in the actual space can be determined based on the following steps:

[0039] (1) Place the acquisition device in Figure 3 At the position Ls2 and the position Ls3 indicated in the figure.

[0040] (2) Since x, y, and z in Ls2 (x, y, z) have been preset, Ly = Ls2.y - ΔY0 can be obtained based on the collected information of the Ls2 device, where ΔY0 is the offset of the human body information collected by the device on the Y axis. This offset is the offset between the collected human body center point and the camera position, which can be calculated using the data collected by the camera. The specific calculation process is not described in detail.

[0041] (3) Similarly, Lz=Ls2.z-ΔZ0, where ΔZ0 is the offset of the human body information collected by the device on the Z axis.

[0042] (4) Based on the position information of Ls3 (x, y, z), Lx = Ls3.x + ΔX0 can be calculated, where ΔX0 is the offset of the human body information collected by the device on the X-axis.

[0043] The teaching information includes real-time audio and video information generated during the teaching process, as well as teaching interaction information and teaching interaction touch information generated by the teacher during the teaching process.

[0044] Specifically, teaching interaction information can be understood as interactive information of the teacher during the teaching period, including screen touch information, blackboard information, etc. Teaching interaction touch information includes information about the tool used by the teacher to touch the screen during the teaching process, such as a stylus, finger, etc.

[0045] The environmental information includes lighting information, environmental color information and environmental texture information generated in the teaching environment.

[0046] The above-mentioned embodiment can overcome the positioning error caused by the offset between the human body and the camera position, and can realize the digital teacher's teaching in the local real scene.

[0047] In one embodiment, please refer to Figure 4 The acquisition device includes a multi-eye camera Ls1 arranged on the side of the teaching teacher for collecting real-time position information L from a first position, a first camera Ls2 arranged on the side of the teaching teacher for collecting human body movement posture skeleton information P1, teaching teacher facial expression information P2, and human body surface texture information P3 from a second position, a depth sensor Ls3 arranged on the side of the teaching teacher for collecting real-time position information L from a third position, and a second camera Ls4 arranged on the side of the teaching teacher for collecting human body movement posture skeleton information P1, teaching teacher facial expression information P2, and human body surface texture information P3 from a fourth position.

[0048] Specifically, the placement of the above-mentioned devices can refer to Figure 4 In one embodiment, a radar device may be placed at the position Ls3 to assist in verifying the position information.

[0049] It should be noted that the video streams captured by the first camera Ls2 and the second camera Ls4 can be further transmitted to the terminal, and combined to form human body image data after being processed.

[0050] The collection device also includes an audio and video collection device for collecting audio and video information S1 of the monitoring location, and a teaching information collection device for collecting teaching interaction information S2 of the teacher in the teaching process at the monitoring location.

[0051] The collection device also includes an environmental information E collection device for collecting environmental information of the monitoring location.

[0052] In the above embodiments, the information of the lecturer, teaching information and environmental information is collected through multi-type and multi-directional devices, and presented through real-scene interaction, so that the listeners can have a good sense of immersion in front of the digital speaker in the real space.

[0053] In one embodiment, in step S2, the terminal provided at the lecture end constructs a three-dimensional model of a live digital remote interactive teaching space based on the lecturer information, teaching information and environmental information, including:

[0054] Step S21, the terminal at the listening end constructs a three-dimensional environment model of the teaching space corresponding to the teaching end based on the collected environment information E.

[0055] Step S22, the terminal located at the listening end restores the collected audio and video information S1 and the teaching interaction information S2 in the three-dimensional environment model to restore the audio and video existing in the teaching space of the teaching end, as well as the video presented on the teaching screen during the teaching process, and the interaction between the teacher and the teaching screen.

[0056] Step S23, a terminal located at the lecture end constructs a human body simulation model based on the collected human body movement and posture skeleton information P1, and restores the facial expression and human body surface layer of the lecturer on the human body simulation model based on the collected facial expression information P2 and human body surface texture information P3 of the lecturer.

[0057] Step S24, the terminal arranged at the lecture end synchronizes the human body simulation model to the three-dimensional environment model according to the collected real-time position information L.

[0058] What needs to be explained based on steps S21 to S24 is that the terminal located at the listening end, when determining that the teaching teacher at the teaching end and the teaching screen are interacting, will obtain the first interaction data generated in the teaching process, and compare and verify the first interaction data with the second interaction data generated between the virtual teacher and the teaching screen at the listening end (that is, compare the two sets of data. When there is an error between the two sets of data, make a slight adjustment to the position data in the listening environment, and slowly change the position information in the listening environment so that its position information gradually becomes consistent with the touch information of the teaching end) to avoid errors and ensure dynamic position balance.

[0059] In the above embodiments, half of the content of the captured screen can be restored on the virtual end screen, restoring the teaching content used by the teaching teacher in the teaching environment and the interaction between the virtual teacher and the teaching space, making the virtual and real more fitting in the real scenario.

[0060] In one of the embodiments, in step S3, based on the device linkage technology, the three-dimensional model is mapped and presented at the corresponding teaching position in the listening end, so that a teaching scene completely consistent with the teaching end can be presented in the listening end, including:

[0061] Step S31, based on the device linkage technology, synchronize the digital screen of the listening end carrying the virtual image with the real teaching teacher at the teaching end in terms of digital image, spatial position, human body posture, blackboard writing content, human body expression, and audio, so that a simulation presentation consistent with the teaching end can be presented in the listening end.

[0062] In one of the embodiments, in step S31, the spatial position synchronization between the digital screen of the listening end carrying the virtual image and the real teaching teacher at the teaching end includes:

[0063] Step S311, obtain the real-time position information (L.x, L.y, L.z) of the real teaching teacher at the teaching end, and preset the proportional parameter W and the offset S.

[0064] Step S312, when it is determined that L.x < -x1, let W = (L.x + x1) / (x3 + x1) and S = 0; when it is determined that -x1 < L.x < x1, let W = L.x / 2x1 and S = 1; when it is determined that L.x > x1, let W = (L.x - x1) / (x2 - x1) and S = 2, where x1, x2, and x3 are the environmental information collected at the corresponding teaching end.

[0065] Step S313, after determining the values of the proportional parameter W and the offset S, if S = 0, then let L.X0 = W * (X03 + X01) - X01; if S = 1, then let L.X0 = L.x * 2X01; if S = 2, then let L.X0 = W * (X02 - X01) + X01, where X01, X02, and X03 are the environmental information collected at the corresponding listening end.

[0066] Step S314, let L.Y0 = L.y and L.Z0 = L.z, and synchronize the spatial position of the digital screen of the listening end carrying the virtual image with the real teaching teacher at the teaching end based on (L.X0, L.Y 0, L.Z0).

[0067] Regarding step S314, it should be noted that since the height of the two teaching screens in the classroom where the real teacher is located and the classroom equipped with the digital screen of the listening end with the virtual image are the same and the distance from the ground is the same, when the shape of the real teacher at the teaching end is collected, the height of the shape can be directly displayed on the digital screen of the listening end of the virtual image, and there is no need to calculate the Y value additionally, so L.Y0 = Ly. On the other hand, since in step S1, the relevant position information of the real teacher at the teaching end can be directly collected, no additional calculation process is required, so L.Z0 = Lz.

[0068] For further information, please refer to Figure 5 , a digital teacher presentation medium is placed in the classroom equipped with a digital screen at the lecture end with virtual images. The medium includes but is not limited to transparent screens and other presentation media. This medium needs to be moved by a carrier to keep its position consistent with the position of the teacher at the lecture end. This carrier includes but is not limited to: rails, AMR autonomous mobile collaborative robots, etc., to achieve the image presentation at the lecture end. In general, the following synchronization rules need to be met during implementation:

[0069] (1) Real-time position synchronization, that is, the position of the teacher at the listening end and the teacher at the teaching end should be synchronized in real time to restore the interaction between the teacher and the environment and the teaching screen in the real teaching environment;

[0070] (2) Human body information synchronization, that is, the movements, postures, and expressions presented by the teacher at the listening end should be synchronized with the real teacher at the teaching end in real time, so as to create a more realistic and immersive teaching environment for the students at the listening end;

[0071] (3) Synchronization of teaching content, that is, the video, audio and other data information displayed by the teaching equipment at the listening end should be synchronized with the teaching end in real time, making the interaction between the virtual teacher at the listening end and the real environment more realistic.

[0072] Furthermore, in one embodiment, real-time feedback and adjustment functions can be provided based on the interactive data between teachers and students. For example, teachers can compare data based on students' semantic question-and-answer feedback, accurately retrieve the digital content of the teacher's explanation process of relevant questions, and present it through the system, so as to restore the real scene of people, things and objects in the entire teaching process, provide students with digital and personalized teaching guidance, and play a good role in interactive teaching and teaching supervision.

[0073] The above-mentioned embodiments provide a more realistic and immersive remote teaching experience, enable real-time interaction and feedback between teachers and students, and effectively improve the teaching and learning effects of remote teaching.

[0074] Please refer to Figure 6, the present application discloses a design system for a real-person digital simulation teaching space, the system comprising a data acquisition module, a three-dimensional modeling module and an interactive control module, wherein:

[0075] The data acquisition module is used to trigger the acquisition device located at the teaching end to digitally acquire information about the teaching space and the teacher, and transmit the acquired teacher information, teaching information and environmental information to the listening end.

[0076] The three-dimensional modeling module is used to trigger the terminal located at the lecture end to build a three-dimensional model of a real-person digital remote interactive teaching space based on the lecturer information, teaching information and environmental information.

[0077] The interactive control module is used to map and present the three-dimensional model at the corresponding teaching position in the listening end based on the device linkage technology, so that a teaching scene that is completely consistent with that of the teaching end can be presented at the listening end.

[0078] In one of the embodiments, each module in the system is also used to execute the method in any optional implementation of the above embodiment.

[0079] As can be seen from the above, the design system of a real-person digital simulation teaching space disclosed in the present application digitally collects the teaching space and the teacher through the collection device arranged at the teaching end, and transmits the collected teacher information, teaching information and environmental information to the listening end; the terminal arranged at the listening end constructs a three-dimensional model of the real-person digital remote interactive teaching space based on the teacher information, teaching information and environmental information; based on the equipment linkage technology, the three-dimensional model is mapped and presented at the corresponding teaching position in the listening end, so that the listening end can present a teaching scene that is completely consistent with the teaching end. The implementation of this scheme can form a controllable simulation interactive environment in a controlled space, provide digital collection and digital remote presentation for speakers in a large space, and solve the problem of synchronizing the original handwriting blackboard content and the speech content in a real controllable environment during the digital speech, so that the listeners can have a good sense of immersion in the real space facing the digital speaker.

[0080] The embodiment of the present application provides a readable storage medium, and when the computer program is executed by the processor, the method in any optional implementation of the above embodiment is executed. Wherein, the storage medium can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (Static Random Access Memory, referred to as SRAM), electrically erasable programmable read-only memory (Electrically Erasable Programmable Read-Only Memory, referred to as EEPROM), erasable programmable read-only memory (Erasable Programmable Read Only Memory, referred to as EPROM), programmable read-only memory (Programmable Red-Only Memory, referred to as PROM), read-only memory (Read-Only Memory, referred to as ROM), magnetic memory, flash memory, disk or optical disk.

[0081] The above-mentioned readable storage medium digitally collects the teaching space and the teacher through the collection device at the teaching end, and transmits the collected teacher information, teaching information and environmental information to the listening end; the terminal at the listening end constructs a three-dimensional model of the real-person digital remote interactive teaching space based on the teacher information, teaching information and environmental information; based on the device linkage technology, the three-dimensional model is mapped and presented at the corresponding teaching position in the listening end, so that the listening end can present a teaching scene that is completely consistent with the teaching end. The implementation of this solution can form a controllable simulated interactive environment in a controlled space, provide digital collection and digital remote presentation for speakers in a large space, and solve the problem of synchronizing the original handwriting blackboard content and the speech content in a real controllable environment during the digital speech, so that the listeners can have a good sense of immersion in the real space facing the digital speaker.

[0082] In the embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. The device embodiments described above are merely schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some communication interfaces, and the indirect coupling or communication connection of the devices or units can be electrical, mechanical or other forms.

[0083] In addition, the units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0084] Furthermore, the functional modules in the various embodiments of the present application may be integrated together to form an independent part, or each module may exist independently, or two or more modules may be integrated to form an independent part.

[0085] In this document, relational terms such as first and second, etc. are used merely to distinguish one entity or operation from another entity or operation, but do not necessarily require or imply any such actual relationship or order between these entities or operations.

[0086] The above description is only an embodiment of the present application and is not intended to limit the protection scope of the present application. For those skilled in the art, the present application may have various modifications and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application shall be included in the protection scope of the present application.

Claims

1. A design method for a real-person digital simulation teaching space, characterized in that: The following steps are involved: S1. A collection device at the teaching end digitally collects the teaching space and the teacher, and transmits the collected teacher information, teaching information and environmental information to the listening end; S2, a terminal located at the lecture end constructs a three-dimensional model of a real-person digital remote interactive teaching space based on the lecturer information, teaching information and environmental information; S3. Based on the device linkage technology, the three-dimensional model is mapped and presented at the corresponding teaching position in the listening end, so that a teaching scene that is completely consistent with that of the teaching end can be presented at the listening end.

2. The method according to claim 1, characterized in that In step S1, the teaching teacher information includes human body movement information, human body facial expression information, human body surface texture information, and human body position information; The teaching information includes real-time audio and video information generated during the teaching process, as well as teaching interaction information and teaching interaction touch information generated by the teacher during the teaching process; The environmental information includes lighting information, environmental color information and environmental texture information generated in the teaching environment.

3. The method according to claim 2, characterized in that The acquisition device includes a multi-eye camera Ls1 arranged on the side of the teaching teacher for collecting real-time position information L from a first position, a first camera Ls2 arranged on the side of the teaching teacher for collecting human body action posture skeleton information P1, teaching teacher facial expression information P2, and human body surface texture information P3 from a second position, a depth sensor Ls3 arranged on the side of the teaching teacher for collecting real-time position information L from a third position, and a second camera Ls4 arranged on the side of the teaching teacher for collecting human body action posture skeleton information P1, teaching teacher facial expression information P2, and human body surface texture information P3 from a fourth position; The collection device also includes an audio and video collection device for collecting audio and video information S1 of the monitoring position, and a teaching information collection device for collecting teaching interaction information S2 of the teacher in the teaching process at the monitoring position; The collection device also includes an environmental information E collection device for collecting environmental information of the monitoring location.

4. The method according to claim 3, characterized in that In step S2, the terminal provided at the lecture end constructs a three-dimensional model of a real-person digital remote interactive teaching space based on the lecturer information, teaching information and environmental information, including: S21, the terminal at the lecture end constructs a three-dimensional environment model of the teaching space corresponding to the lecture end based on the collected environment information E; S22, the terminal at the listening end restores the collected audio and video information S1 and the teaching interaction information S2 in the three-dimensional environment model to restore the audio and video existing in the teaching space of the teaching end, as well as the video presented on the teaching screen during the teaching process, and the interaction between the teacher and the teaching screen; S23, a terminal provided at the lecture end builds a human body simulation model based on the collected human body action posture skeleton information P1, and restores the lecturer's facial expression and human body surface layer on the human body simulation model based on the collected lecturer's facial expression information P2 and human body surface texture information P3; S24. The terminal arranged at the lecture end synchronizes the human body simulation model to the three-dimensional environment model according to the collected real-time position information L.

5. The method according to claim 1, characterized in that In step S3, based on the device linkage technology, the 3D model is mapped and presented at the corresponding teaching position in the listening end, so that a teaching scene exactly the same as that in the teaching end can be presented in the listening end, including: S31. Based on the device linkage technology, the digital screen of the listening end carrying the virtual image is synchronized with the real teacher in the teaching end in terms of digital image, spatial position, human body posture, blackboard writing content, human expression, and audio, so that a simulation presentation consistent with that in the teaching end can be presented in the listening end.

6. The method according to claim 1, characterized in that In step S31, the synchronization of the spatial position between the digital screen of the listening end carrying the virtual image and the real teacher in the teaching end includes: S311. Obtain the real-time position information (L.x, L.y, L.z) of the real teacher in the teaching end, a preset proportional parameter W, and an offset S; S312. When it is determined that L.x < -x1, let W = (L.x + x1) / (x3 + x1) and S = 0; when it is determined that -x1 < L.x < x1, let W = L.x / 2x1 and S = 1; when it is determined that L.x > x1, let W = (L.x - x1) / (x2 - x1) and S = 2, where x1, x2, and x3 are the environmental information collected at the corresponding teaching end; S313. After determining the values of the proportional parameter W and the offset S, if S = 0, let L.X0 = W * (X03 + X01) - X01; if S = 1, let L.X0 = L.x * 2X01; if S = 2, let L.X0 = W * (X02 - X01) + X01, where X01, X02, and X03 are the environmental information collected at the corresponding listening end; S314, let L.Y0 = Ly, L.Z0 = Lz, based on (L.X0, LY 0, L.Z0) synchronizes the spatial position of the digital screen at the listening end equipped with virtual images with the real teacher at the teaching end.

7. A design system for a real-person digital simulation teaching space, characterized in that: The system includes a data acquisition module, a 3D modeling module, and an interactive control module, where: The data acquisition module is used to trigger the acquisition device arranged at the teaching end to digitally acquire the teaching space and the teacher, and transmit the acquired teacher information, teaching information, and environmental information to the listening end; The 3D modeling module is used to trigger the terminal arranged at the listening end to construct a 3D model of the real-person digital remote interactive teaching space based on the teacher information, teaching information, and environmental information; The interactive control module is used to map and present the 3D model at the corresponding teaching position in the listening end based on the device linkage technology, so that a teaching scene exactly the same as that in the teaching end can be presented in the listening end.

8. A readable storage medium, characterized in that: The readable storage medium includes a design method program for the real-person digital simulation teaching space. When the design method program for the real-person digital simulation teaching space is executed by a processor, the steps of the method described in any one of claims 1 to 6 are implemented.

Images