Holographic interactive teaching system and implementation method thereof

Abstract

The invention discloses a holographic interactive teaching system and an implementation method thereof, and belongs to the technical field of holographic interactive teaching. An image and sound of a teacher are collected at a holographic teaching end, the image of the teacher and holographic materials are fused and rendered to obtain a holographic fusion image, meanwhile, the holographic fusion image is transmitted to a holographic listening end at a far end through a network, and students at the holographic listening end see the holographic fusion image from a holographic screen and see teaching courseware from an auxiliary display unit; student pictures and sounds of the holographic lecture attending end are transmitted to the holographic lecture giving end in real time through a network to be displayed and played, the holographic lecture giving end and the holographic lecture attending end are in real-time communication through the network, teachers in a lecture classroom can interact with students in the lecture attending classroom in real time, and through cooperation of a holographic screen and a holographic black screen, the teaching effect is improved. Students in the lecture listening classrooms look like that teachers take classes in the lecture listening classrooms, the problems existing in cross-campus remote teaching of the teachers are solved, and the coverage and beneficiary of high-quality educational resources are expanded.

Description

Technical Field

[0001] This invention relates to the field of holographic interactive teaching technology, specifically to a holographic interactive teaching system and its implementation method. Background Technology

[0002] In recent years, with the further deepening and advancement of comprehensive reforms in basic education, various regions across the country have begun to implement group-based school management for primary and secondary schools. This approach aims to optimize the balanced allocation of educational resources, expand the coverage and beneficiaries of high-quality educational resources, comprehensively improve the balance and coordination of basic education development, promote high-quality development of basic education, and advance educational equity. However, in practice, due to time and space limitations, situations still arise where renowned teachers deliver lectures, but the number of students attending is limited. While existing live-streaming teaching models address this issue to some extent, the lack of interaction and communication between teachers and students during live-streaming, coupled with the inability of teachers to see the students' progress, results in poor actual teaching effectiveness, with students' learning efficiency far lower than in traditional classroom teaching.

[0003] In higher education, with the rapid increase in the number of university students in my country, many schools have established branch campuses in different locations due to their continuous expansion. How to balance the teaching resources among the campuses and avoid teachers having to travel between different campuses all year round is a difficult and painful issue that these universities urgently need to solve in cross-campus teaching.

[0004] Currently, primary and secondary schools and universities have introduced many multimedia teaching systems for daily teaching, but existing multimedia teaching systems and related information technology equipment cannot effectively solve the above problems. Summary of the Invention

[0005] To address the problems existing in the prior art, this invention proposes a holographic interactive teaching system and its implementation method.

[0006] One objective of this invention is to propose a holographic interactive teaching system.

[0007] The holographic interactive teaching system of the present invention includes: a holographic teaching terminal and a holographic listening terminal; wherein, The holographic teaching terminal includes a holographic core host, a holographic server, a teaching terminal image acquisition unit, a teaching reflection display unit, a background screen, a teaching terminal audio unit, and teaching terminal network equipment. In the classroom where the holographic teaching terminal is located, the background screen is arranged vertically, and the teacher is positioned in front of the background screen. The teaching terminal image acquisition unit faces the teacher. The teaching reflection display unit includes three teaching reflection display devices, with their display surfaces facing the teacher. The first teaching reflection display device displays the teaching materials, the second displays the holographic fused image of the teacher and the background, and the third displays the image of students listening to the lesson on the holographic listening terminal. The teaching terminal image acquisition unit, teaching reflection display unit, and teaching terminal audio unit are respectively connected to the holographic core host, and the holographic core host is connected to the holographic server through the teaching terminal network equipment. The holographic learning terminal includes a holographic node host, a holographic screen unit, a holographic projection unit, a learning terminal auxiliary display unit, a learning terminal image acquisition unit, a learning terminal audio unit, and learning terminal network equipment. The holographic screen unit includes a holographic screen and a holographic black screen. The holographic screen is a holographic projection screen with light transmittance greater than 50%, and the display area of ​​the holographic screen is smaller than its actual size. The holographic black screen is a completely light-absorbing black screen. In the classroom where the holographic learning terminal is located, the holographic screen and the holographic black screen are arranged vertically, with the holographic screen positioned above the holographic black screen. Previously, the two were parallel to each other and there was a distance between them. The distance between the holographic black screen and the holographic screen was determined by the width of the holographic screen. The holographic projection unit faced the holographic screen unit. The listening end image acquisition unit faced the student. The listening end auxiliary display unit included at least one listening end auxiliary display device, with the display surface facing the student, displaying the teaching courseware. The holographic projection unit, the listening end auxiliary display unit, the listening end image acquisition unit, and the listening end audio unit were respectively connected to the holographic node host. The holographic node host was connected to the holographic server through the listening end network device. The holographic screen has a light transmittance of over 50%. Behind the holographic screen is a completely light-absorbing holographic black screen. When viewed from the front, most light passes through the holographic screen and is absorbed by the holographic black screen behind it. Only a small portion of the light is reflected by the holographic screen before entering the human eye. This weakens the presence of the holographic screen in the human visual perception, making it appear inconspicuous. At the holographic learning terminal, when the holographic projection unit projects the holographic fused image onto the display area of ​​the holographic screen, most of the light passes through the holographic screen and is received by the holographic black screen behind it. A small portion of the light forms a holographic image on the holographic screen, which is then diffusely reflected and seen by the students. Furthermore, the brightness of the holographic fused image is much higher than that of the image not illuminated by the projected light. The projection onto the holographic screen area further weakens the visual presence of the holographic screen, making it almost imperceptible. Furthermore, the space between the holographic screen and the holographic black screen behind it creates the illusion that the holographic image is suspended in mid-air, providing students with a highly realistic holographic visual experience. The holographic image of the teacher on the screen is highly consistent with the real person, making the teacher's holographic image appear even more realistic. The holographic teaching end and the holographic listening end communicate in real time via the network, allowing the teacher in the teaching classroom to interact with the students in the listening classroom in real time, making it appear to the students as if the teacher is actually teaching in the listening classroom.

[0008] The holographic black screen is larger than the holographic screen to ensure that all light passing through the holographic screen is absorbed by the holographic black screen. Students are located within the imaging field of view of the image acquisition unit at the listening end.

[0009] Distance between holographic black screen and holographic screen Width of the holographic screen The relationship between them satisfies: in and The unit for all of them is meters (m).

[0010] Furthermore, the holographic teaching terminal also includes an auxiliary display unit. If students are simultaneously attending a lecture in the classroom where the holographic teaching terminal is located, an auxiliary display unit is set up in the classroom. This auxiliary display unit includes two display devices, positioned against the walls on either side of the classroom, with their display surfaces facing the students. One display device displays the lecture slides, and the other displays a holographic image of the teacher blended with the background. During lectures, the holographic core host at the teaching terminal sends the holographic image and lecture slides to the two display devices for real-time display. The auxiliary display unit is connected to the holographic core host.

[0011] The holographic teaching terminal also includes a lighting unit, which is set on the ceiling in front of the background screen to provide supplementary lighting for the teacher and the background screen.

[0012] In the classroom where the holographic teaching terminal is located, a backdrop is placed in front of and parallel to the blackboard. The backdrop is arranged vertically from top to bottom, with its bottom hanging down to the ground and extending forward along the ground. During class, the teacher stands on the backdrop extending from the ground, with the backdrop serving as the teacher's background. The teacher is within the imaging field of view of the image acquisition unit of the teaching terminal, obtaining a complete image during image processing. Furthermore, the backdrop is connected to a lifting device, which controls the vertical height of the backdrop and its raising or lowering.

[0013] The teaching-end audio unit includes a teaching-end sound pickup unit, a teaching-end audio processing unit, and a teaching-end sound reinforcement unit. The teaching-end sound pickup unit and the teaching-end sound reinforcement unit are connected to the teaching-end audio processing unit. The teaching-end sound pickup unit is either a ceiling-mounted microphone or a wireless microphone. The ceiling-mounted microphone is positioned above the teacher's standing area and does not require wearing or holding. The wireless microphone needs to be worn or held by the teacher to collect sound. The collected sound is processed by the teaching-end audio processing unit for noise reduction and enhancement, and then transmitted to the teaching-end sound reinforcement unit and the holographic core host. The teaching-end sound reinforcement unit uses speakers and power amplifiers to amplify the processed sound. The speakers are connected to the power amplifier, and are placed in the four corners of the classroom. If the classroom is large, two more speakers may be needed in the center.

[0014] The holographic core host integrates and renders the teacher's image with holographic materials, including images, videos, or 3D models.

[0015] The holographic teaching terminal also includes a teaching control unit, which can be a tablet computer, mobile phone, or desktop computer. The holographic core host, holographic server, teaching terminal image acquisition unit, teaching reflection display unit, teaching terminal audio unit, teaching terminal auxiliary display unit, lighting unit, and teaching terminal network equipment are all connected to the teaching control unit via the network. The teaching control unit controls the power on and off of all teaching terminal devices with one-button power-on and one-button power-off.

[0016] The holographic projection unit of the holographic learning terminal uses a projector mounted on a lifting device, which controls the projector's spatial position. The holographic projection unit employs a high-brightness laser projector with a brightness exceeding 12,000 lumens.

[0017] The holographic black screen and the bottom of the holographic screen hang down to near the ground, remaining suspended in mid-air; the holographic projection unit is set above the classroom directly in front of the holographic screen, and its projection area is guaranteed to fill the holographic screen; the size of the projected image is adjustable, and the actual display area can be adjusted according to the actual situation.

[0018] The auxiliary display unit for the listening end includes at least one auxiliary display device for the listening end, with the display face facing the student, displaying the teaching courseware, and is set on both sides of the holographic screen or on both sides of the classroom wall.

[0019] The audio unit for the listening end includes a listening end sound pickup unit, a listening end audio processing unit, and a listening end sound reinforcement unit. The listening end sound pickup unit and the listening end sound reinforcement unit are connected to the listening end audio processing unit. The listening end sound pickup unit is either a ceiling-mounted microphone or a wireless microphone. The ceiling-mounted microphone is placed above the area where students sit and does not require wearing or holding. The wireless microphone needs to be worn or held by the student to collect sound. The collected sound is processed by the listening end audio processing unit for noise reduction and enhancement, and then transmitted to the listening end sound reinforcement unit and the holographic node host. The listening end sound reinforcement unit consists of speakers and power amplifiers, with the speakers placed in the four corners of the classroom. If the classroom is large, two more speakers may be needed in the center.

[0020] The image acquisition unit at the listening end is located at the top center of the holographic screen, with its lens facing the student area, enabling it to capture all students in the classroom.

[0021] The display area of ​​the holographic screen is located in the center of the holographic screen, and the width and height of the display area are 5-20cm smaller than the width and height of the holographic screen.

[0022] The holographic learning terminal also includes a learning control unit, which can be a tablet computer, mobile phone, or desktop computer. The holographic node host, holographic projection unit, learning terminal auxiliary display unit, learning terminal image acquisition unit, learning terminal audio unit, and learning terminal network device are all connected to the learning control unit via the network. The learning control unit controls the power on and off of all learning terminal devices with one-button power-on and one-button power-off.

[0023] Another objective of this invention is to propose a method for implementing a holographic interactive teaching system.

[0024] The implementation method of the holographic interactive teaching system of the present invention includes the following steps: 1) Holographic teaching terminal: The image acquisition unit at the teaching end captures the teacher's lecturing image in real time and transmits it to the holographic core host. The holographic core host uses a keying algorithm to separate the teacher's image from the background, then merges and renders the teacher's image with the holographic material to form a holographic fused image corresponding to the teaching materials. This image is then transmitted to the second teaching reflection display device. Simultaneously, the holographic core host transmits the internally stored teaching materials to the first teaching reflection display device. The first teaching reflection display device displays the teaching materials in real time, while the second teaching reflection display device displays the teacher and background fused in real time. The combined holographic image is displayed in real time on the third teaching reflection display device, showing the students listening to the lesson on the holographic listening terminal. The audio unit captures the teacher's voice in real time, processes and amplifies it to obtain audio information, and plays it out. At the same time, this audio information is transmitted to the holographic core host. The holographic core host encodes the teaching courseware image, the holographic combined image, the teacher's audio information, and the audio in the teaching courseware, and transmits it to the holographic server through the teaching terminal network device. The holographic server then transmits the encoded data to the remote holographic listening terminal through the network. 2) Holographic Learning Terminal: The holographic node host receives data transmitted from the holographic server via the network, decodes and reconstructs the teaching materials' visuals, holographic fusion image, teacher's audio information, and the audio from the teaching materials. Then, it transmits the holographic fusion image to the holographic projection unit. The holographic projection unit enhances the holographic fusion image and projects the enhanced, high-brightness holographic fusion image onto the holographic screen unit for display, while also transmitting the teaching materials' visuals to the auxiliary display unit at the listening end. Students see the teacher giving a real-time holographic lesson from the holographic screen unit and from the auxiliary display unit at the listening end. The auxiliary display unit displays the teaching materials; the holographic node host transmits the teacher's audio information and the audio from the teaching materials to the listening end audio unit for processing, amplification, and playback; the listening end audio unit captures the students' voices in the classroom, processes and amplifies them to obtain audio information, and plays it, while simultaneously transmitting this audio information to the holographic node host; the listening end image acquisition unit captures the images of the students in the classroom and transmits them to the holographic node host, which encodes the images and audio information of the students in the classroom and transmits them to the holographic server via the network; 3) Interactive teaching: The holographic server at the holographic teaching end then transmits this data to the holographic core host. The holographic core host decodes the received data and transmits the image of students listening to the lesson in the classroom to the third teaching reflection display device, allowing the teacher to see the situation of the students in the remote classroom in real time. The sound of the students talking in the classroom is transmitted to the audio unit at the teaching end, processed, amplified and played out. The teacher and students in the teaching classroom can also hear the sound of the students talking in the classroom, and the teacher and students can conduct remote real-time audio and video interactive teaching. 4) Holographic effect: The holographic screen has a light transmittance of over 50%. Behind the holographic screen is a completely light-absorbing holographic black screen. When viewed from the front, most light passes through the holographic screen and is absorbed by the holographic black screen behind it. Only a small portion of the light is reflected by the holographic screen before entering the human eye. This weakens the presence of the holographic screen in the human visual perception, making it appear inconspicuous. When the holographic projection unit projects a holographic image onto the display area of ​​the holographic screen, most of the light passes through the holographic screen and is received by the holographic black screen behind it. A small portion of the light forms a holographic image on the holographic screen, which is then diffusely reflected and seen by the student. Furthermore, the brightness of the holographic image is much higher than that of the holographic image not illuminated by the projected light. The dome area further weakens the visual presence of the holographic screen, making it almost imperceptible. Furthermore, there is space between the holographic screen and the holographic black screen behind it, visually creating a suspended holographic image. This setup provides students in front of the screen with a very realistic holographic visual effect. The holographic image of the teacher on the screen is highly consistent with the real person, making the teacher's holographic image appear even more realistic. The holographic teaching end and the holographic listening end communicate in real time via the network, allowing the teacher in the teaching classroom to interact with the students in the listening classroom in real time, making it appear to the students in the listening classroom as if the teacher were actually teaching in the listening classroom.

[0025] Advantages of this invention: The holographic interactive teaching system proposed in this invention captures the teacher's image and sound at the holographic teaching terminal. The teacher's image is processed and then fused with holographic materials to create a holographic fused image. The teaching slides and the holographic fused image are displayed in the classroom and simultaneously transmitted via network to a remote holographic listening terminal. Students at the listening terminal see the holographic fused image on a holographic screen and the teaching slides on an auxiliary display unit. The students' images and sound at the listening terminal are transmitted in real-time to the holographic teaching terminal for display and playback. Real-time communication exists between the holographic teaching terminal and the listening terminal via the network, allowing the teacher in the teaching classroom to interact with the students in the listening classroom in real time. To the students in the listening classroom, it appears as if the teacher is actually present in the classroom. The advantages of this holographic interactive teaching system are as follows: (1) The teacher's image is integrated with holographic materials to form a holographic fusion image. The teacher's image is organically combined with the knowledge being taught, making the teaching more vivid, expanding students' thinking and vision, making it easier for students to understand and accept the knowledge they have learned, and improving students' listening and learning efficiency.

[0026] (2) Students at the holographic listening terminal can see the holographic image of the teacher on the holographic screen and can interact with the teacher in real time, eliminating the spatial barrier between students and teachers, eliminating the sense of strangeness brought about by remote teaching, and making students in the listening classroom feel as if the teacher is actually teaching in the listening classroom, thus solving the problem of teachers teaching across campuses.

[0027] (3) When a teacher teaches on a holographic teaching terminal, students on multiple holographic listening terminals can listen to the lecture at the same time, allowing more students to hear the lectures of famous teachers in an immersive way and interact with them, thus expanding the classroom of famous teachers and increasing the coverage and benefits of high-quality educational resources. Attached Figure Description

[0028] Figure 1 This is a connection block diagram of an embodiment of the holographic interactive teaching system of the present invention; Figure 2 This is a schematic diagram of the teaching terminal of an embodiment of the holographic interactive teaching system of the present invention; Figure 3 This is a schematic diagram of the listening terminal of an embodiment of the holographic interactive teaching system of the present invention. Detailed Implementation

[0029] The present invention will be further described below with reference to the accompanying drawings and specific embodiments.

[0030] like Figure 1 As shown, the holographic interactive teaching system of this embodiment includes: a holographic teaching terminal and a holographic listening terminal; wherein, The holographic system includes a holographic core host, a holographic server, an image acquisition unit 12 for the teaching end, a lighting unit 8, an auxiliary display unit 6 for the teaching end, a teaching reflection unit 9, a background screen 3, a sound reinforcement unit 5 for the teaching end, an audio unit for the teaching end, network equipment for the teaching end, and a teaching control unit. In the classroom where the holographic teaching end is located, the background screen 3 is arranged vertically from top to bottom in front of the blackboard 2 at the teaching end and parallel to the blackboard 2. The bottom of the background screen 3 hangs down to the floor of the teaching end's podium 1 and extends forward along the floor. During class, the teacher stands on the background screen extending from the floor. The background screen 3 is connected to a first lifting device 4, which controls the vertical height of the screen and its raising or lowering. The image is displayed on the screen during image processing. The teacher is positioned in front of the background screen 3, which serves as the teacher's background. The teaching-end image acquisition unit 12 is located directly in front of the background screen 3. The teaching-end image acquisition unit 12 uses a camera mounted on a camera lift 11, which is positioned approximately 7 meters in front of the screen unit. The camera lift 11 is at a height consistent with that of a normal adult, with the camera lens pointing directly at the background screen 3. The teacher is positioned within the imaging field of view of the teaching-end image acquisition unit 12. The lighting unit 8 is located on the ceiling in front of the background screen 3, providing supplementary lighting for the teacher and the background screen 3. The teaching reflection display unit 9 includes three teaching reflection display devices. The holographic teaching terminal is mounted on the ceiling approximately 4 meters in front of the background screen 3, with its display facing the teacher. The first reflective display device shows the teaching materials, the second displays the holographic image of the teacher blended with the background, and the third displays the image of students listening at the holographic listening end. If students are also listening in the classroom, an auxiliary display unit 6 is set up in the same room. This auxiliary display unit 6 includes two display devices mounted against the walls on either side of the classroom, with their display faces facing the students. One device displays the teaching materials, and the other displays the holographic image of the teacher blended with the background. The audio is also displayed. The unit includes a teaching-end sound pickup unit, a teaching-end audio processing unit, and a teaching-end sound amplification unit. The teaching-end sound pickup unit and the teaching-end sound amplification unit are respectively connected to the teaching-end audio processing unit. The teaching-end sound pickup unit includes a first suspended microphone 7 and a second suspended microphone 10. The first suspended microphone 7 is set above the area where the teacher stands and does not need to be worn or held in hand during use. The wireless microphone, on the other hand, needs to be worn or held by the teacher to collect sound. In the classroom where the holographic teaching end is located, there are students listening to the lecture at the same time. The second suspended microphone 10 is set above the area where the students are located. The collected sound is processed by the teaching-end audio processing unit for noise reduction and enhancement, and then transmitted to the teaching-end sound amplification unit and the holographic core host respectively.The teaching-end sound reinforcement unit 5 uses speakers to amplify the processed sound. The speakers are connected to a power amplifier, and are positioned in the four corners of the classroom. If the classroom is large, two more speakers may be needed in the center. The teaching-end auxiliary display unit 6, teaching-end image acquisition unit 12, teaching-end reflective display unit 9, and teaching-end audio unit are connected to the holographic core host. The holographic core host is connected to the holographic server via the teaching-end network equipment and is located in a cabinet in a corner at the front of the classroom. The teaching control unit uses a tablet computer. The holographic core host, holographic server, teaching-end image acquisition unit 12, teaching-end reflective display unit 9, teaching-end audio unit, teaching-end auxiliary display unit, lighting unit, and teaching-end network equipment are all connected to the teaching control unit via a network. The teaching control unit controls all teaching-end devices with one-button power on and off.

[0031] The holographic learning terminal includes a holographic node host, a holographic screen unit, a holographic projection unit 31, a learning terminal auxiliary display unit 26, a learning terminal image acquisition unit 29, a learning terminal audio unit, a learning terminal network device, and a learning control unit. The holographic screen unit includes a holographic screen 28 and a holographic black screen 23. The holographic screen 28 is a holographic projection screen with light transmission capability, having a light transmittance of approximately 65%. The display area of ​​the holographic screen 28 is smaller than the size of the holographic screen 28 itself. To ensure that a life-size holographic image of the teacher can be displayed on the holographic screen 28, the aspect ratio is 16:9. The minimum width of the holographic screen 28 is 3.5 meters, and the minimum height is 2 meters. The area displaying the holographic fused image has a width of 3.38 meters and a height of 1.9 meters. The holographic black screen 23 is... The holographic black screen 23 is a fully light-absorbing black screen, with a width greater than that of the holographic screen 28, to ensure that all light passing through the holographic screen 28 is absorbed by the holographic black screen 23. In the classroom where the holographic learning terminal is located, the holographic screens 28 and 23 are arranged vertically from top to bottom, with their bottoms hanging down close to the ground, remaining suspended. The holographic black screen 23 is positioned in front of the blackboard 22 at the learning terminal, on the lectern 21, flush against and parallel to the blackboard 22. The holographic screen 28 is positioned in front of the holographic black screen 23, parallel to each other with a distance between them. This distance is determined by the width of the holographic screen 28. With the width of the holographic screen 28 The relationship between them satisfies: The holographic screen 28 and holographic black screen 23 are respectively connected to the second lifting device 27 and the third lifting device 24; the holographic projection unit 31 faces the holographic screen 28 and uses a projector, which is installed on the lifting device and its spatial position is controlled by the lifting device; the listening end image acquisition unit 29 uses a camera, which is set at the top center of the holographic screen 28, with its lens facing the student area, and can capture all students in the classroom; the listening end auxiliary display unit 26 includes two listening end auxiliary display devices, which are respectively set on both sides of the holographic screen 28 or on both sides of the classroom wall, with the display surface facing the students, and displaying the teaching courseware; the listening end audio unit includes a listening end sound pickup unit 30, a listening end audio processing unit, and a listening end sound amplification unit 25, which are respectively connected to the listening end audio processing unit; the listening end sound pickup unit 30 is a ceiling microphone or a wireless microphone, which is set above the area where the students sit and does not require wearing or hand use. The wireless microphone needs to be worn or held by the student to collect sound. The collected sound is processed by the audio processing unit at the listening end for noise reduction and enhancement, and then transmitted to the listening end sound reinforcement unit 25 and the holographic node host respectively. The listening end sound reinforcement unit 25 consists of listening end speakers and power amplifiers, etc. The speakers are placed in the four corners of the classroom. If the classroom is large, two more need to be placed in the middle of the classroom. The holographic projection unit 31, the listening end auxiliary display unit 26, the listening end image acquisition unit 29, and the listening end audio unit are connected to the holographic node host respectively. The holographic node host is connected to the holographic server through the listening end network device. The listening control unit uses a tablet computer. The holographic node host, holographic projection unit 31, listening end auxiliary display unit 26, listening end image acquisition unit 29, listening end audio unit, and listening end network device are connected to the listening control unit through the network. The listening control unit controls the power on and off of all listening end devices with one-button power-on and one-button power-off.

[0032] During the lecture, at the holographic teaching end, the image acquisition unit captures the teacher's image in real time and transmits it to the holographic core host. The holographic core host uses a keying algorithm to separate the teacher's image from the background, then merges and renders the teacher's image with the holographic material to form a holographic fused image corresponding to the lecture slides. This image is then transmitted to the second teaching reflection display device. Simultaneously, the holographic core host transmits the internally stored lecture slides to the first teaching reflection display device. The first teaching reflection display device displays the lecture slides in real time, while the second teaching reflection display device... The system displays a holographic image of the teacher blended with the background, while the third teaching reflection display device displays the students' listening screen in real time. The audio unit captures the teacher's voice in real time, processes and amplifies it to obtain audio information, and plays it out. At the same time, this audio information is transmitted to the holographic core host. The holographic core host encodes the teacher's teaching slides, the holographic image, the teacher's audio information, and the audio in the teaching slides, and transmits it to the holographic server through the teaching terminal network device. The holographic server then transmits the encoded data to the remote holographic listening terminal via the network. At the holographic learning terminal, the holographic node host receives data transmitted from the holographic server via the network, decodes and reconstructs the teacher's lecture slides, holographic fused images, the teacher's audio information, and the audio from the lecture slides. The holographic fused image is then transmitted to the holographic projection unit 31, which enhances the holographic fused image and projects the enhanced, high-brightness holographic fused image onto the holographic screen 28 for display. The lecture slides are also transmitted to the auxiliary display unit 26 at the learning terminal for display. Students see the holographic fused image of the teacher giving a live lecture at the holographic teaching terminal from the holographic screen 28 and the lecture slides from the auxiliary display unit 26. The holographic node host transmits the teacher's audio information and the audio from the lecture slides to the audio unit at the learning terminal for processing, amplification, and playback. The audio unit at the learning terminal transmits the students' spoken audio from the lecture slides to the audio unit at the learning terminal for processing, amplification, and playback. The audio of the students' speech is captured, processed, amplified, and played back. Simultaneously, this audio information is transmitted to the holographic node host. The image acquisition unit 29 at the listening end captures images of the students in the classroom and transmits them to the holographic node host. The holographic node host encodes the images and audio information of the students in the classroom and transmits them to the holographic server via the network. The holographic server at the holographic teaching end then transmits this data to the holographic core host. The holographic core host decodes the received data and transmits the images of the students listening to the lesson to the third teaching reflection display device, allowing the teacher to see the students in the remote classroom in real time. The sound of the students speaking in the listening classroom is transmitted to the audio unit at the teaching end for processing, amplification, and playback. The teacher and students in the teaching classroom can also hear the students speaking in the listening classroom, enabling teachers and students to conduct remote, real-time audio-visual interactive teaching. The holographic screen 28 has a light transmittance of 65%. Behind the holographic screen 28 is a holographic black screen 23 that absorbs all light. When looking at the holographic screen 28 from the front, 65% of the light passes through the holographic screen 28 and is absorbed by the holographic black screen 23 behind it. Only 35% of the light is reflected by the holographic screen 28 and enters the human eye. This weakens the presence of the holographic screen 28 in the human visual effect, making it appear inconspicuous. When the holographic projection unit 31 projects the holographic fused image onto the holographic screen 28, most of the light passes through the holographic screen 28 and is received by the holographic black screen 23 behind it. A small portion of the light forms a holographic image on the holographic screen 28 and is seen by the students through diffuse reflection. Furthermore, the brightness of the holographic fused image is much higher than that of the image not illuminated by the projected light. The area of ​​the holographic screen 28 that is projected further weakens the visual presence of the holographic screen 28, making it almost imperceptible. Furthermore, there is space between the holographic screen 28 and the holographic black screen 23 behind it, making the holographic image appear to float in the air. This setup provides students in front of the holographic screen 28 with a very realistic holographic visual effect. Moreover, the holographic image of the teacher on the holographic screen 28 is one-to-one with the real person, making the teacher's holographic image look even more realistic. The holographic teaching end and the holographic listening end communicate in real time via the network, allowing the teacher in the teaching classroom to interact with the students in the listening classroom in real time, making it appear to the students in the listening classroom as if the teacher is actually teaching in the listening classroom.

[0033] Finally, it should be noted that the purpose of disclosing the embodiments is to help further understand the present invention. However, those skilled in the art will understand that various substitutions and modifications are possible without departing from the spirit and scope of the present invention and the appended claims. Therefore, the present invention should not be limited to the content disclosed in the embodiments, and the scope of protection of the present invention is defined by the claims.

Claims

1. A holographic interactive teaching system, characterized by, The holographic interactive teaching system comprises a holographic teaching end and a holographic listening end, wherein The holographic teaching end comprises a holographic core host, a holographic server, a teaching end image acquisition unit, a teaching end reverse display unit, a background curtain, a teaching end audio unit and a teaching end network device; in a teaching classroom where the holographic teaching end is located, the background curtain is arranged along a vertical plane, and a teacher is located in front of the background curtain; the teaching end image acquisition unit is directed at the teacher; the teaching end reverse display unit comprises first to third teaching end reverse display devices; the teaching end image acquisition unit, the teaching end reverse display unit and the teaching end audio unit are respectively connected to the holographic core host, and the holographic core host is connected to the holographic server through the teaching end network device; The holographic listening end comprises a holographic node host, a holographic curtain unit, a holographic projection unit, a listening end auxiliary display unit, a listening end image acquisition unit, a listening end audio unit and a listening end network device; the holographic curtain unit comprises a holographic curtain and a holographic black curtain, the holographic curtain is a holographic projection curtain with light transmission capability, the light transmission rate is greater than 50%, and the display area of the holographic curtain is smaller than the size of the holographic curtain; the holographic black curtain is a full-absorption black curtain; in a listening classroom where the holographic listening end is located, the holographic curtain and the holographic black curtain are arranged along a vertical plane, the holographic curtain is located in front of the holographic black curtain, the two are parallel to each other and have a distance therebetween, and the distance between the holographic black curtain and the holographic curtain is determined by the width of the holographic curtain; the holographic projection unit is directed at the holographic curtain unit; the listening end image acquisition unit is directed at students; the listening end auxiliary display unit displays teaching courseware; the holographic projection unit, the listening end auxiliary display unit, the listening end image acquisition unit and the listening end audio unit are respectively connected to the holographic node host, and the holographic node host is connected to the holographic server through the listening end network device; At the holographic listening end, the holographic fusion image is projected onto the display area of the holographic curtain, most of the light is transmitted through the holographic curtain and received by the holographic black curtain behind the holographic curtain, a small part of the light forms a holographic image on the holographic curtain and is seen by the students through diffuse reflection, and the brightness of the holographic fusion image is much higher than that of the holographic curtain area not irradiated by the projected light, weakening the existence of the holographic curtain in the visual effect; further, there is a space between the holographic curtain and the holographic black curtain behind it, and the holographic fusion image is visually suspended in the air, bringing a very realistic holographic visual effect to the students in front of the holographic curtain; and the teacher holographic fusion image on the holographic curtain is highly consistent with the real person, making the teacher holographic fusion image look more realistic; the holographic teaching end and the holographic listening end communicate in real time through the network, and the teacher in the teaching classroom can interact with the students in the listening classroom in real time, and the students in the listening classroom see it as if the teacher is teaching in the listening classroom.

2. The holographic interactive teaching system as claimed in claim 1, wherein, The distance between the holographic black curtain and the holographic curtain The width of the holographic curtain The relationship between them satisfies: 。 3. The holographic interactive teaching system as claimed in claim 1, wherein, The teaching end also comprises a teaching end auxiliary display unit; if there are students in the classroom where the holographic teaching end is located, the teaching end auxiliary display unit is arranged in the classroom where the holographic teaching end is located; the teaching end auxiliary display unit comprises two display devices arranged on the walls on both sides of the classroom, and the display surfaces of the display devices face the students, one of the display devices displays the teaching courseware, and the other display device displays the holographic fusion image of the teacher fused with the background.

4. The holographic interactive teaching system as claimed in claim 1, wherein, The display surface of the teaching reverse display unit faces the teacher, the first teaching reverse display device displays the teaching courseware, the second teaching reverse display device displays the holographic fusion image of the teacher fused with the background, and the third teaching reverse display device displays the image of the students listening to the course at the holographic listening end.

5. The holographic interactive teaching system as claimed in claim 1, wherein, The teaching end audio unit comprises a teaching end sound pickup unit, a teaching end audio processing unit and a teaching end sound amplification unit; the teaching end sound pickup unit and the teaching end sound amplification unit are respectively connected to the teaching end audio processing unit, the teaching end sound pickup unit is a suspended microphone or a wireless microphone, the suspended microphone is arranged above the area where the teacher stands, and does not need to be worn or held during use, and the wireless microphone needs to be worn on the body or held in the hand of the teacher to collect sound; the collected sound is subjected to noise reduction and enhancement processing by the teaching end audio processing unit, and then transmitted to the teaching end sound amplification unit and the holographic core host.

6. The holographic interactive teaching system as claimed in claim 1, wherein, The listening end auxiliary display unit comprises at least one listening end auxiliary display device, and the display surface faces the students.

7. The holographic interactive teaching system as claimed in claim 1, wherein, The holographic teaching end also comprises a teaching control unit, which is a tablet computer, a mobile phone or a desktop computer; the holographic core host, the holographic server, the teaching end image acquisition unit, the teaching reverse display unit, the teaching end audio unit, the teaching end auxiliary display unit, the lighting unit and the teaching end network device are respectively connected to the teaching control unit through a network, and are controlled by the teaching control unit, one-key start and one-key shutdown, and control the on-off of all teaching end devices.

8. The holographic interactive teaching system as claimed in claim 1, wherein, The holographic projection unit adopts a high-brightness laser projector with a brightness greater than 12000 lumens.

9. The holographic interactive teaching system as claimed in claim 1, wherein, The display area of the holographic screen is located in the center of the holographic screen, and the width and height of the display area of the holographic screen are both less than 5-20 cm of the width and height of the holographic screen.

10. A method of implementing a holographic interactive teaching system as claimed in any one of claims 1 to 9, characterized in that, The implementation method comprises the following steps: 1) holographic teaching end: The image acquisition unit of the teaching end collects the image of the teacher's teaching and transmits it to the holographic core host. The holographic core host separates the teacher's image from the background by image extraction algorithm, then fuses the teacher's image with the holographic material to form a holographic fusion image corresponding to the teaching courseware, and transmits it to the second teaching anti-display device. At the same time, the holographic core host transmits the internally stored teaching courseware to the first teaching anti-display device; the first teaching anti-display device displays the picture of the teaching courseware in real time, the second teaching anti-display device displays the holographic fusion image after the teacher and the background are fused, and the third teaching anti-display device displays the picture of the students in the holographic listening end when they are listening to the class; the audio unit collects the teacher's teaching sound in real time, then processes and amplifies it to obtain audio information and plays it out, and transmits the audio information to the holographic core host; the holographic core host encodes the picture of the teaching courseware, the holographic fusion image, the teacher's teaching audio information and the audio in the teaching courseware, and transmits them to the holographic server through the teaching end network device; the holographic server transmits the encoded data to the holographic listening end far away through the network; 2) Holographic listening end: The holographic node host receives the data transmitted by the holographic server through the network, decodes and restores the picture of the teaching courseware, the holographic fusion image, the teacher's teaching audio information and the audio in the teaching courseware, and then transmits the holographic fusion image to the holographic projection unit; the holographic projection unit enhances the holographic fusion image and projects the enhanced high-brightness holographic fusion image to the holographic curtain unit for display, and transmits the picture of the teaching courseware to the listening end auxiliary display unit for display; the students see the holographic fusion image of the teacher in the holographic teaching end from the holographic curtain unit, and see the picture of the teaching courseware from the listening end auxiliary display unit; the holographic node host transmits the teacher's teaching audio information and the audio in the teaching courseware to the listening end audio unit for processing and amplification and plays it out; the listening end audio unit collects the sound of the students in the listening classroom, processes and amplifies it to obtain audio information and plays it out, and transmits the audio information to the holographic node host; the listening end image acquisition unit collects the picture of the students in the listening classroom and transmits it to the holographic node host, which encodes the picture of the students in the listening classroom and the audio information and transmits them to the holographic server through the network; 3) Interactive teaching: The holographic server of the holographic teaching end transmits the data to the holographic core host, which decodes the received data and transmits the picture of the students in the listening classroom to the third teaching anti-display device, so that the teacher can see the situation of the students in the remote listening classroom in real time. The sound of the students in the listening classroom is transmitted to the teaching end audio unit for processing and amplification and played out, so that the teacher and the students in the teaching classroom can hear the sound of the students in the listening classroom. The teacher and the students can conduct real-time audio and video interactive teaching remotely; 4) Holographic effect: The light transmittance of the holographic screen is greater than 50%, and the rear of the holographic screen is a holographic black screen with full light absorption; when viewed from the front of the holographic screen, most of the light is transmitted through the holographic screen and absorbed by the holographic black screen behind, only a small part of the light is reflected by the holographic screen and enters the human eye, the existence of the holographic screen is weakened in the visual effect of the human, and the holographic screen does not look obvious; when the holographic projection unit projects the holographic fusion image onto the display area of the holographic screen, most of the light is transmitted through the holographic screen and received by the holographic black screen behind, a small part of the light forms a holographic image on the holographic screen and is seen by the student through diffuse reflection, and the brightness of the holographic fusion image is much higher than that of the area of the holographic screen which is not irradiated by the projected light, further weakening the existence of the holographic screen in the visual effect, and almost no existence of the holographic screen can be felt; further, there is a space between the holographic screen and the holographic black screen behind it, and the holographic fusion image is suspended in the air in the visual effect, which brings a very realistic holographic visual effect to the student in front of the holographic screen; and the teacher holographic fusion image on the holographic screen is consistent with the height of the real person, making the teacher holographic fusion image look more real; the holographic teaching end and the holographic listening end communicate in real time through the network, and the teacher in the teaching classroom can interact with the student in the listening classroom in real time, and the student in the listening classroom thinks that the teacher is teaching in the listening classroom.

Images