Immersive teaching method based on smart classroom system device

Abstract

The invention relates to the technical field of smart classrooms, in particular to an immersive teaching method based on a smart classroom system device, which comprises the steps that a campus area service cloud performs data communication with each smart room and is connected with a radio-over-fiber switch system, a personnel attendance system, a light control system and an air conditioner control system; the system is formed by connecting a door and window monitoring system, a ventilation system, a video monitoring system and an immersive teaching hardware system in combination with an immersive teaching method. The immersive teaching method of the smart classroom system device is characterized in that the immersive teaching method is based on the smart classroom system device so as to provide full-coverage network connection, computing power, automation and intelligentization, and multiple capabilities such as communication, perception, calculation, AI, big data and safety are integrated; according to the immersive teaching learning method, an approximately real learning environment is provided for learners through virtual reality, augmented reality and mixed reality technologies, so that the learners can improve skills by highly participating in interaction and drilling.

Description

Technical Field

[0001] The present invention relates to the technical field of smart classrooms, and in particular to an immersive teaching method based on a smart classroom system device. Background Art

[0002] Smart classrooms, colleges and universities began to explore and innovate early, such as the Massachusetts Institute of Technology's "Technology-Enabled Active Learning" program, North Carolina State University's SCALE-UP project, the University of Iowa's "Transformation, Interaction, Learning, Engagement" project, and some schools have launched immersive teaching projects that combine the new generation of information technology to help students master multiple languages ​​and skills at the same time.

[0003] Influenced by this and in order to promote the important strategy of modernization, relevant management departments have issued a series of education construction policies and smart campus-related documents to guide schools to promote the construction of smart campuses through the deep integration of new generation information technologies such as the Internet, cloud computing, artificial intelligence, big data and education and teaching in new infrastructure, educational resource data, application services, and security assurance.

[0004] Therefore, the construction of smart classrooms in colleges and universities started from the early 1.0 construction, to the smart classroom 2.0 construction, and then to the smart classroom 3.0+ construction standard in 2022. In the process of continuous improvement, certain results have been achieved in quantity, type, environment, design, etc. For example, Tsinghua University has achieved content optimization, resource sharing, and teacher-student interaction, which greatly meets the learning needs of learners; Shanghai Jiaotong University, from the perspective of supporting a variety of hybrid teaching modes, has built smart classrooms including intelligent control physical environment, activity space layout, cloud course platform, clicker, cloud recording and broadcasting functions. Their purpose is to use modern means to cut into the entire teaching process to make the classroom simple, efficient, and intelligent, improve the quality of teaching, help develop students' independent thinking and learning ability, and promote the construction of educational equity and modernization of educational management.

[0005] However, with the continuous advancement of science and technology, the application of today's 5G and even the upcoming 6G new generation information technology in smart campuses will bring unprecedented changes and challenges. For example, 5G's high speed and low-latency full coverage cannot provide powerful data processing capabilities for immersive teaching methods, and the experience of ensuring the stable operation of the teaching system still needs to be further improved. Summary of the invention

[0006] In view of this, an embodiment of the present invention provides an immersive teaching method based on a smart classroom system device to solve the problem that 5G needs to further improve its speed and low-latency full coverage, and cannot provide learners with a close-to-real learning environment through virtual reality technology, so that learners can improve their skills through highly involved interactions and drills.

[0007] The technical solution of the present invention to solve the above problems is: an immersive teaching method based on a smart classroom system device, including a campus service cloud that communicates data with each smart room and is connected to a fiber-optic wireless switch system, a personnel attendance system, a lighting control system, an air conditioning control system, a door and window monitoring system, a ventilation system, a video surveillance system, and an immersive teaching hardware system combined with an immersive teaching method. Its characteristics are: the immersive teaching method of the smart classroom system device is based on the smart classroom system device to provide full coverage of network connection, computing power, automation and intelligence, integrating communication, perception, computing, AI, big data, security and other capabilities, and providing learners with a close-to-real learning environment through virtual reality, augmented reality, and mixed reality technologies, so that learners can improve their skills through highly involved interaction and drills. An immersive teaching learning method.

[0008] The optical wireless switch system is installed in the network cabinet of the smart classroom, connected to the original wired network switch, and connected to the school computer network (cloud server). The optical wireless switch has two built-in WiFi access points (APs), supports speeds up to 1TB / s and microsecond delays, processes all network protocols, baseband data and radio frequency signals, distributes WiFi signals to the classroom through analog optical fiber links, and achieves wireless coverage. It is also connected to the perception devices of the immersive teaching hardware system, such as smart phones, iPads, 3D display devices or 3D glasses, and also includes voice recognition, face recognition, motion recognition and other sensor devices, providing comprehensive perception capabilities. Smart terminals and wearable devices and various WiFi terminals can be connected to a unified WiFi local area network to form an overall smart classroom platform for storing and calculating smart classroom devices and immersive teaching course model content, providing powerful data processing capabilities, and ensuring that the immersive teaching method can run stably on the device platform of the smart classroom.

[0009] The immersive teaching method includes an immersive teaching hardware system and a control module. The immersive teaching hardware system includes an electronic whiteboard and a multimedia touch display integrated machine installed on the front wall, a projector installed on the ceiling and a power amplifier speaker installed on the front wall, a wireless microphone pickup and an interrogator installed on the desk, and a head-mounted display. The virtual image can be superimposed on the real world through a transparent screen or lens system while retaining the perception of the real environment, or mixed reality glasses can combine virtual content with the real world, or handheld devices including smart phones, tablets and AR glasses can be installed with dedicated applications or additional devices to watch virtual content. And interact with the real environment, as well as the position tracker, motion controller and depth camera, which can be used to capture the characteristics of movement and environment to achieve more natural and accurate interaction. The position tracker captures the mobile environment in real time through cameras and sensors, the depth camera is used to obtain three-dimensional information of the environment, and the motion controller is used to manipulate virtual objects. It also includes a perception system, voice recognition, face recognition, action recognition and other sensing devices. Through multi-channel projection fusion technology, a close to real learning environment is presented in the smart classroom technology classroom, so that learners can improve their skills through highly involved interaction and drills. The teaching method is applied to language teaching, music teaching, nature teaching and other learning.

[0010] The control module is used to configure the basic parameters of the teaching mode and the teaching content, allocate the applications required for the instantiated teaching scenes, set the three-dimensional imaging range of each teaching content scene, and manage the dynamic generation of teaching content scene instances. It includes: the user-side teacher mode, student mode, parent participation mode, etc. are used to establish a communication connection with the classroom scene instance or the teaching content scene instance according to the user experience needs of teachers and students, collect the positioning data and interactive operations of the teacher and student user terminals, send them to the scene instance, receive the immersive experience screen sent by the scene instance and display it to the user. When the user enters multiple scenes at the same time, the user can set the three-dimensional display range of each scene in the user experience space through the user-side module, and can also set the posture and scaling of the scene in the user experience space.

[0011] The teacher mode method and steps include: 1. Log in to the teacher end of the smart classroom system; 2. Prepare lessons before class, teachers obtain and organize teaching resources through the smart classroom system, and provide a variety of rich teaching content for classroom teaching preparation; 3. Teaching courses during class, including recorded courses, personalized courses, distance learning, immersive teaching, etc., to achieve real-time interactive courses between students and teachers in different locations; 4. Teaching management and evaluation, including student attendance, teaching progress, classroom interaction, etc.; 5. Adjust and maintain the teaching environment to ensure the normal operation of the equipment.

[0012] The student mode, the method steps include: 1. Log in to the student end of the smart classroom system; 2. Pre-class preparation: In the smart classroom system, students can use the system to preview the relevant teaching resources provided by the teacher before class, including courseware, recorded videos, exercises, etc., so that students can understand the course content in advance, which is helpful to improve students' research interest and effect; 3. Classroom course selection: In the classroom, the smart classroom system can realize student attendance, classroom interaction and teaching resource sharing, experience immersive teaching course content scenes and other functions, students can sign in, ask questions, answer questions, etc. through the system, and teachers can adjust and evaluate teaching according to students' feedback; 4. Review after class: After class, students can review the classroom content through the system, including recorded videos, teaching materials, online tests, etc., to consolidate research results and improve research effects.

[0013] The parent participation model, method and steps include: 1. Log in to the parent end of the smart classroom system; 2. Parent information sharing: realize information sharing and interaction between parents and schools; 3. Parent interaction: parents can understand students' research status and evaluation results through the system, communicate and exchange with teachers, and pay attention to students' research progress together.

[0014] The personnel attendance system is composed of an RFID attendance machine, an attendance card and supporting control software; the asset management system is composed of an ultra-high frequency RFID reader, a paper label, an anti-metal label and supporting control software. RFID attendance machines are installed at the front and back doors of the classroom respectively, and RFID tags (campus cards) are used to conduct attendance statistics for students, identify the identities of people entering the classroom, conduct attendance statistics for legal users, and issue alarms to illegal users. At the same time, through WiFi wireless coverage, attendance information can be remotely monitored, counted, archived and printed.

[0015] The lighting control system is composed of a lighting controller, a light sensor, a human body sensor, a curtain control system and supporting control software. The human body sensor is used to determine whether there is someone at the corresponding position in the classroom. If no one is there, the lighting control system and the curtain control system are in a closed state, otherwise, they are in a working state; the curtain control system collects the data of the light sensor installed on the window, and according to the preset threshold value of the software, the curtain automatically opens and closes to realize the compensation of the light intensity in the classroom; the lighting control system collects the data of the light sensor installed in the classroom, and controls the automatic opening and closing of the lights in the classroom by analyzing the data and according to the preset value of the software, and can adjust the brightness of the lights to realize the intelligent control and energy saving and emission reduction of indoor lights; the air conditioning control system is composed of a central air conditioning power controller, a temperature and humidity sensor and supporting control software. The indoor temperature is monitored by the temperature and humidity sensor, and the air conditioning is automatically turned on when the indoor temperature and humidity are higher than the highest threshold value by analyzing the data and according to the preset value of the software, and the air conditioning is automatically turned off when the indoor temperature and humidity are lower than the lowest threshold value, so as to realize the automatic control of the indoor temperature and humidity.

[0016] The door and window monitoring system is composed of a window door magnetic module and supporting software. The window door magnetic module is used to detect the switch status of doors and windows, and upload the status information to the server in time. At the same time, sensitive time periods are set to implement automatic monitoring and alarm of windows.

[0017] The ventilation system consists of an exhaust fan, a CO2 sensor and supporting monitoring software. The CO2 concentration in the room is monitored by the CO2 sensor. By analyzing the data and based on the software preset value, the exhaust fan is automatically turned on for ventilation when the indoor CO2 concentration is higher than the software threshold value, thereby reducing the indoor CO2 concentration by adding outdoor air.

[0018] The video surveillance system is composed of a WiFi wireless camera and supporting monitoring software, which can provide a query basis for the security system, asset entry and exit, and personnel entry and exit. In order to monitor the entry and exit of personnel and assets, a WiFi wireless camera is installed at the front and back doors of the classroom. At the same time, a WiFi wireless camera is installed inside the classroom to monitor the internal situation of the classroom in real time. These image data are transmitted to the terminal management computer through the remote radio frequency unit to provide real-time monitoring data.

[0019] Beneficial effects: An immersive teaching method based on a smart classroom system device uses the above system device to cut into the entire teaching process using modern means to solve the problem that 5G needs to further improve its speed and low-latency full coverage, etc., which cannot be solved through virtual reality technology, to create a more intelligent campus service platform, and provide learners with a learning environment close to the real thing, so that learners can improve their skills through highly involved interactions and drills. The immersive teaching learning method can make the classroom simple, efficient, and intelligent, improve the quality of teaching, help develop students' independent thinking and learning ability, and promote the construction of educational equity and modernization of educational management. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] Figure 1 Schematic diagram of the smart classroom system of the present invention.

[0021] Figure 2 This is a schematic diagram of the immersive teaching hardware system of the present invention.

[0022] Figure 3 This is a control schematic diagram of the immersive teaching method of the present invention.

[0023] Markings in the figure: optical wireless switch system 1, personnel attendance system 10, lighting control system 11, air conditioning control system 12, door and window monitoring system 13, ventilation system 14, video monitoring system 15, immersive teaching hardware system 16, multimedia touch display integrated machine 160, projector 161, power amplifier speaker 162, wireless microphone pickup 163, question and answer machine 164, head-mounted display 165, mixed reality glasses 166, handheld device 167, position tracker 168, immersive teaching method 2, control module 2 0, teacher mode 21, teacher end of smart classroom system 211, lesson preparation before class 212, in-class teaching courses 213, recorded courses 2130, personalized courses 2131, remote teaching 2132, immersive teaching 2133, teaching management and evaluation 214, teaching environment adjustment and maintenance 215, student mode 22, student end of smart classroom system 220, preparation before class 221, class course selection 222, review after class 223, parent participation mode 23, parent end of smart classroom system 230, parent information sharing 231, parent interaction 232. DETAILED DESCRIPTION

[0024] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of the present invention.

[0025] like Figure 1As shown, an immersive teaching method based on a smart classroom system device includes a campus service cloud that communicates data with each smart room, a fiber-optic wireless switch system 1, a personnel attendance system 10, a lighting control system 11, an air conditioning control system 12, a door and window monitoring system 13, a ventilation system 14, a video surveillance system 15, and an immersive teaching hardware system 16 combined with an immersive teaching method 2. It is characterized in that: the immersive teaching method 2 of the smart classroom system device is based on the smart classroom system device to provide full coverage of network connection, computing power, automation and intelligence, integrating communication, perception, computing, AI, big data, security and other capabilities, and providing learners with a close-to-real learning environment through virtual reality, augmented reality, and mixed reality technologies, so that learners can improve their skills through highly involved interaction and drills. An immersive teaching learning method.

[0026] like Figure 1 As shown, the cloud server is connected to the network and connected to the optical fiber wireless switch system 1 installed in the network cabinet of the smart classroom. The optical fiber wireless switch has two built-in WiFi access points (APs), supports a speed of up to 1TB / s and a delay of microseconds, processes all network protocols, baseband data and radio frequency signals, and distributes WiFi signals to the classroom through analog optical fiber links to achieve wireless coverage. It is also connected to the perception devices of the immersive teaching hardware system 16, such as smart phones, iPads, 3D display devices or 3D glasses, and also includes voice recognition, face recognition, motion recognition and other sensor devices, providing comprehensive perception capabilities. Smart terminals and wearable devices and various WiFi terminals can be connected to a unified WiFi local area network to form an overall smart classroom platform for storing and calculating smart classroom devices and immersive teaching course model content, providing powerful data processing capabilities, and ensuring that the immersive teaching method can run stably on the device platform of the smart classroom.

[0027] like Figure 2As shown, the immersive teaching method 2 includes an immersive teaching hardware system 16 and a control module 20. The immersive teaching hardware system 16 includes an electronic whiteboard ‌ multimedia touch display all-in-one 160 installed on the front wall, a projector 161 installed on the ceiling and a power amplifier speaker 162 on the front wall, a wireless microphone pickup 163 and an answering machine 164 installed on the lecture table and desk, and a head-mounted display 165, which can superimpose virtual images into the real world through a transparent screen or lens system while retaining the perception of the real environment, or ‌ mixed reality glasses 166 can combine virtual content with the real world, or ‌ handheld devices 167 include smart phones, tablet computers and AR glasses, etc., by installing dedicated applications or Additional equipment can be used to watch virtual content and interact with the real environment, as well as a position tracker, a motion controller and a depth camera 168, which can be used to capture the user's movement and environmental characteristics to achieve more natural and accurate interaction. The position tracker captures the user's environment in real time through cameras and sensors, the depth camera is used to obtain three-dimensional information of the environment, and the motion controller is used to manipulate virtual objects. It also includes a perception system: including a variety of sensing devices such as voice recognition, face recognition, and action recognition. Through multi-channel projection fusion technology, a close-to-real learning environment is presented in the smart classroom technology classroom, allowing learners to improve their skills through highly involved interactions and drills. The teaching method is applied to language teaching, music teaching, natural teaching and other learning.

[0028] like Figure 3 As shown, the control module 20 is used to configure the basic parameters of the teaching mode and the teaching content, allocate the applications required for the instantiated teaching scene, set the three-dimensional imaging range of each teaching content scene, and manage the dynamic generation of teaching content scene instances. It includes: the user-side teacher mode 21, the student mode 22, the parent participation mode 23, etc., which are used to establish a communication connection between the teaching content and the classroom scene instance according to the needs of teachers, students and parents, collect the positioning data and interactive operations of the teacher, student and parent user terminals, send them to the scene instance, receive the immersive experience screen sent by the scene instance and display it to the user. When the user enters multiple scenes at the same time, the user can set the three-dimensional display range of each scene in the user experience space through the user-side module, and can also set the posture and scaling of the scene in the user experience space.

[0029] like Figure 3As shown, the teacher mode 21, the method steps include: 1. The teacher end 211 of the smart classroom system; 2. Creation and realization of pre-class preparation 212: teachers obtain and organize teaching resources through this system, and provide editing of a variety of rich teaching content for classroom teaching preparation; 3. Teaching courses 213 in class, teachers can use this system to choose recorded courses 2130, personalized courses 2131, distance learning 2132, immersive teaching 2133 and other teaching; 4. Teaching management and evaluation 214: this system can be used to realize student attendance, teaching progress, classroom interaction, current asset management, etc.; 5. Teaching environment adjustment and maintenance 215, this system can ensure the normal operation of the equipment.

[0030] like Figure 3 As shown, the student mode 22, the method steps include: 1. Smart classroom system student end 220: creation and implementation are divided into 1.1 Pre-class preparation 2201: Students can use this system to preview the relevant teaching resources provided by the teacher, such as courseware, recorded videos, exercises, etc., so that students can understand the course content in advance, which is helpful to improve students' research interest and effect; 1.2 Classroom class 2202: Students enter the classroom to attend class. This system can realize functions such as student attendance, classroom interaction and teaching resource sharing, and experience immersive teaching course content scenes. Students can also sign in, ask questions, answer questions, etc. through the system. Teachers can adjust teaching and evaluate interactions based on students' feedback; 2 Post-class review 221: After class, students can review the classroom content through the system, including recorded videos, teaching materials, online tests, etc., to consolidate research results and improve research effects; like Figure 3 As shown, the parent participation mode 23, the method steps include: 1. Log in to the parent end of the smart classroom system 230: create a program to realize information sharing and interaction mode between parents and schools; 2. Parent information sharing 231: parents can understand students' learning situation and evaluation results through the information sharing system; 3. Parent interaction 232: parents can communicate and exchange with teachers, voluntarily participate in various activities of the school, and improve the efficiency and effectiveness of home-school communication.

[0031] The above implementation steps are further applied to language teaching, music teaching, nature teaching and other learning on the basis of the application of smart classrooms. Through virtual reality or augmented reality technology, a close-to-real learning environment is provided for teachers and learners, so that learners can improve their skills through highly involved interactions and drills. Immersive teaching methods are not limited to language learning, but are also used in other fields such as medicine and military training. In the medical field, immersive learning can simulate medical procedures such as surgery and consultations, and provide a realistic virtual environment for training.

[0032] The immersive teaching 2133 example 1 is used in language teaching, such as experiencing the teaching content scenario in the classroom: taking the teaching content of Unit 1 of the third grade English textbook of the People's Education Press: Getting to Know You as an example, by guiding the participation of students' parents, it mainly revolves around self-introduction, family members, and simple expressions in daily life; the teacher first guides students to search for "daily life" scenario stories independently and introduces students to a specific situation; secondly, the teacher asks questions and guides students to use English to introduce themselves, family members, and simple expressions in daily life. Through the study of this unit, students can master basic greetings, ways to introduce themselves, and the names of family members, and can simply describe things in daily life in English. The content of this unit is closely related to the students' real life, which is conducive to stimulating students' interest in learning and cultivating their English listening and speaking skills.

[0033] The immersive teaching 2133 example 2 is used in music teaching. For example, in junior high school music teaching, teachers can use multimedia and other teaching aids to create simulated reality situations, allowing students to experience the charm of music in an immersive way. For example, when teaching "Spring River Moon Night", teachers can use multimedia technology to show beautiful scenery such as the hazy night, the setting sun, and the sunrise in the east, and play corresponding music at the same time to guide students to learn singing skills through vision and hearing; when teaching "Gada Meilin", teachers first guide students to search for the story of "Gada Meilin" independently, and introduce students into a specific situation through storytelling; secondly, teachers raise questions to guide students to explore the cultural heritage in the story. For example, "Which instrument in this piece of music best reflects the characteristics of the Mongolian people? Can you tell me what the characteristics of Mongolian music are?" "What Mongolian customs do you know? Can you play the role of a grassland herdsman and interpret the customs and customs of the Mongolian people?" These questions introduce students to relevant cultural contexts. In response to the first question, a student said: "I think the horse-head fiddle is an instrument that can reflect the characteristics of the Mongolian people. Its sound is like the neighing of a horse, giving people a mournful and long feeling. The Mongolians are a nomadic people. They like horses very much, so their instruments also reflect the characteristics of horses." For the second question, some students performed scenes of Mongolian wrestling, and some students performed scenes of milking sheep, Scenes such as horse riding and grazing; one student combined "Gada Meilin" and put forward his own point of view: "Gada Meilin's struggle was for the grassland, and the life of the Mongolians also revolves around the grassland. They have rough and heroic character traits." "Story-telling" teaching can transform profound and difficult cultural knowledge into interesting stories, allowing students to find a breakthrough in learning, and help students to explore from shallow to deep, gradually transitioning from reading stories to exploring the cultural heritage in the stories.

[0034] like Figure 1As shown, the personnel attendance system 10 is composed of an RFID attendance machine, an attendance card and supporting control software; the asset management system is composed of a UHF RFID card reader, a paper label, an anti-metal label and supporting control software. RFID attendance machines are installed at the front and back doors of the classroom respectively, and RFID tags (campus card) are used to count students' attendance, identify the identity of people entering the classroom, count legal users' attendance, and warn illegal users. At the same time, through WiFi wireless coverage, attendance can be remotely monitored, counted, archived and printed.

[0035] The lighting control system 11 is composed of a lighting controller, a light sensor, a human body sensor, a curtain control system and supporting control software. The human body sensor is used to determine whether there is anyone at the corresponding position in the classroom. If no one is there, the lighting control system and the curtain control system are in a closed state, otherwise they are in a working state; the curtain control system collects data from the light sensors installed on the windows, and automatically opens and closes the curtains according to the preset threshold value of the software to compensate for the light intensity in the classroom; the lighting control system collects data from the light sensors installed in the classroom, analyzes the data, and controls the automatic opening and closing of the lights in the classroom according to the preset value of the software, and can adjust the brightness of the lights to achieve intelligent control of indoor lights and energy saving and emission reduction.

[0036] The air conditioning control system 12 is composed of a central air conditioning power controller, a temperature and humidity sensor and supporting control software. The indoor temperature is monitored by the temperature and humidity sensor, and the air conditioning is automatically turned on when the indoor temperature and humidity are higher than the maximum threshold value, and the air conditioning is automatically turned off when the indoor temperature and humidity are lower than the minimum threshold value according to the software preset value, thereby realizing automatic control of the indoor temperature and humidity.

[0037] The door and window monitoring system 13 is composed of a window door magnetic module and supporting software. The window door magnetic module is used to detect the switch status of doors and windows, and upload the status information to the server in time. At the same time, sensitive time periods are set to implement automatic monitoring and alarm of windows.

[0038] The ventilation system 14 is composed of an exhaust fan, a CO2 sensor and supporting monitoring software. The CO2 concentration in the room is monitored by the CO2 sensor. By analyzing the data and according to the software preset value, when the indoor CO2 concentration is higher than the software threshold value, the exhaust fan is automatically turned on for ventilation, and the indoor CO2 concentration is reduced by adding outdoor air. The video monitoring system 15 is composed of a WiFi wireless camera and supporting monitoring software, which can provide a query basis for the security system, asset entry and exit, and personnel entry and exit. In order to monitor the entry and exit of personnel and assets, a WiFi wireless camera is installed at the front and back doors of the classroom, and at the same time, a WiFi wireless camera is installed inside the classroom to monitor the internal situation of the classroom in real time. These image data are transmitted to the terminal management computer through the remote radio frequency unit to provide real-time monitoring data.

[0039] Through the above-mentioned smart classroom system device combined with immersive teaching methods, modern means are used to cut into the entire teaching process to solve the problem that 5G needs to further improve its speed and low-latency full coverage, which cannot be solved through virtual reality technology, to create a more intelligent campus service platform, and provide learners with a learning environment close to the real thing, so that learners can improve their skills through highly involved interactions and drills. The immersive teaching learning method can make the classroom simple, efficient and intelligent, improve the quality of teaching, help develop students' independent thinking and learning ability, and promote the construction of educational equity and modernization of educational management.

Claims

1. An immersive teaching method based on a smart classroom system device, comprising a campus service cloud that communicates data with each smart room and is connected to an optical wireless switch system (1), a personnel attendance system (10), a lighting control system (11), an air conditioning control system (12), a door and window monitoring system (13), a ventilation system (14), a video monitoring system (15), and an immersive teaching hardware system (16) in combination with an immersive teaching method (2), characterized in that: The immersive teaching method (2) of the smart classroom system device is based on the smart classroom system device to provide full coverage of network connection, computing power, automation and intelligence, integrating multiple capabilities such as communication, perception, computing, AI, big data, and security, and providing learners with a close-to-real learning environment through virtual reality, augmented reality, and mixed reality technologies, so that learners can improve their skills through highly involved interactions and drills. It is an immersive teaching learning method.

2. The immersive teaching method based on the smart classroom system device according to claim 1 is characterized by: The optical wireless switch system (1) is installed in the network cabinet of the smart classroom, connected to the original wired network switch, and connected to the school computer network (cloud server). The optical wireless switch has two built-in WiFi access points (APs), supports a speed of up to 1TB / s and a delay of microseconds, processes all network protocols, baseband data and radio frequency signals, distributes WiFi signals to the classroom through analog optical fiber links, and realizes wireless coverage. It is also connected to the sensing devices of the immersive teaching hardware system (16), such as smart phones, iPads, 3D display devices or 3D glasses, and also includes voice recognition, face recognition, motion recognition and other sensing devices, providing comprehensive sensing capabilities. Smart terminals and wearable devices and various WiFi terminals can be connected to a unified WiFi local area network to form an overall smart classroom platform for storing and calculating smart classroom devices and immersive teaching course model content, providing powerful data processing capabilities, and ensuring that the immersive teaching method can run stably on the device platform of the smart classroom.

3. The immersive teaching method based on the smart classroom system device according to claim 1 or 2 is characterized by: The immersive teaching method (2) comprises an immersive teaching hardware system (16) and a control module (20), wherein the immersive teaching hardware system (16) comprises an electronic whiteboard and a multimedia touch display integrated machine (160) installed on the front wall, a projector (161) installed on the ceiling and a power amplifier and speaker (162) installed on the front wall, a wireless microphone pickup (163) and an answering machine (164) installed on a lecture table or desk, and a head-mounted display (165) that can superimpose virtual images on the real world through a transparent screen or lens system while retaining the perception of the real environment, or mixed reality glasses (166) that can combine virtual content with the real world, or handheld devices (167) including smart phones, tablet computers and AR glasses, etc. By installing dedicated applications or additional devices, virtual content can be viewed and interacted with the real environment, as well as position trackers, motion controllers and depth cameras (168), which can be used to capture the characteristics of movement and environment to achieve more natural and accurate interaction. The position tracker captures the mobile environment in real time through cameras and sensors, the depth camera is used to obtain three-dimensional information of the environment, and the motion controller is used to manipulate virtual objects. It also includes a perception system, voice recognition, face recognition, action recognition and other sensing devices. Through multi-channel projection fusion technology, a learning environment close to reality is presented in the smart classroom technology classroom, which enables learners to improve their skills through highly involved interactions and drills. This teaching method is applied to language teaching, music teaching, natural teaching and other learning.

4. The immersive teaching method based on the smart classroom system device according to claim 3 is characterized by: The control module (20) is used to configure the basic parameters of the teaching mode and the teaching content, allocate the application programs required for instantiating the teaching scene, set the three-dimensional imaging interval of each teaching content scene, and manage the dynamic generation of the teaching content scene instance. It includes: the user-side teacher mode (21), the student mode (22), the parent participation mode 23, etc., which are used to establish a communication connection with the classroom scene instance or the teaching content scene instance according to the user experience requirements of the teacher and the student, collect the positioning data and interactive operations of the teacher and the student user terminals, send them to the scene instance, receive the immersive experience screen sent by the scene instance and display it to the user. When the user enters multiple scenes at the same time, the user can set the three-dimensional display interval of each scene in the user experience space through the user-side module, and can also set the posture and scaling of the scene presented in the user experience space.

5. The immersive teaching method based on the smart classroom system device according to claim 4 is characterized by: The teacher mode (21) includes the following steps:

1. logging into the teacher terminal of the smart classroom system (211); 2. preparing lessons before class (212), where the teacher obtains and organizes teaching resources through the smart classroom system, and provides a variety of rich teaching content for classroom teaching preparation; 3. teaching courses during class (213), including recorded courses (2130), personalized courses (2131), distance learning (2132), immersive teaching (2133), etc., to achieve real-time interactive courses between students and teachers in different locations; 4. teaching management and evaluation (214), including student attendance, teaching progress, classroom interaction, etc.; 5. adjusting and maintaining the teaching environment (215) to ensure the normal operation of the equipment.

6. The immersive teaching method based on the smart classroom system device according to claim 4 is characterized by: The student mode (22) includes the following steps:

1. Log in to the student terminal of the smart classroom system (220); 2. Pre-class preparation (221): In the smart classroom system, students can use the system to preview the relevant teaching resources provided by the teacher before class, including courseware, recorded videos, exercises, etc., so that students can understand the course content in advance, which helps to improve students' research interest and effect; 3. Classroom course selection (222): In the classroom, the smart classroom system can realize student attendance, classroom interaction and teaching resource sharing, and experience immersive teaching course content scenes and other functions. Students can sign in, ask questions, answer questions, etc. through the system, and teachers can adjust and evaluate teaching according to students' feedback; 4. Post-class review (223): After class, students can review the classroom content, including recorded videos, teaching materials, online tests, etc., through the system to consolidate research results and improve research effects.

7. The immersive teaching method based on the smart classroom system device according to claim 4 is characterized by: The parent participation model (23) includes the following steps:

1. Logging in to the parent terminal of the smart classroom system (230); 2. Parent information sharing (231): realizing information sharing and interaction between parents and the school; 3. Parent interaction (232): parents can understand the research status and evaluation results of students through the system, communicate and exchange with teachers, and pay attention to the research progress of students.

8. The immersive teaching method based on the smart classroom system device according to claim 1 is characterized by: The personnel attendance system (10) is composed of an RFID attendance machine, an attendance card and supporting control software; the asset management system is composed of an ultra-high frequency RFID reader, a paper label, an anti-metal label and supporting control software. RFID attendance machines are installed at the front and back doors of the classroom respectively, and RFID tags (campus card) are used to count students' attendance, identify the identities of people entering the classroom, count legal users' attendance, and issue alarms to illegal users. At the same time, through WiFi wireless coverage, attendance information can be remotely monitored, counted, archived and printed; the lighting control system (11) is composed of a lighting controller, a light sensor, a human body sensor, a curtain control system and supporting control software. The human body sensor is used to determine whether there is someone at the corresponding position in the classroom. If no one is there, the lighting control system and the curtain control system are in a closed state, otherwise they are in a working state; the curtain control system collects data from the light sensors installed in the windows and automatically opens and closes the curtains according to the threshold value preset by the software to achieve compensation of the light intensity in the classroom; the lighting control system collects data from the light sensors installed in the classroom, analyzes the data, and controls the automatic opening and closing of the lights in the classroom according to the preset value of the software, and can adjust the brightness of the lights to achieve intelligent control of the indoor lights and energy saving and emission reduction; the air conditioning control system (12) is composed of a central air conditioning power controller, a temperature and humidity sensor and a matching control software The indoor temperature is monitored by a temperature and humidity sensor, and by analyzing the data, according to the preset value of the software, the air conditioner is automatically turned on when the indoor temperature and humidity are higher than the maximum threshold value, and the air conditioner is automatically turned off when the indoor temperature and humidity are lower than the minimum threshold value, thereby realizing automatic control of the indoor temperature and humidity; the door and window monitoring system (13) is composed of a window door magnetic module and supporting software, and the window door magnetic module is used to detect the switch status of doors and windows, and upload the status information to the server in time, and set sensitive time periods to implement automatic monitoring and alarm of windows; the ventilation system (14) is composed of an exhaust fan, a CO2 sensor and supporting monitoring software, and the CO2 concentration in the room is monitored by the CO2 sensor. By analyzing the data and according to the preset value of the software, when the indoor CO2 concentration is higher than the software threshold value, the exhaust fan is automatically turned on for ventilation, and the indoor CO2 concentration is reduced by adding outdoor air; the video monitoring system (15) is composed of a WiFi wireless camera and supporting monitoring software, which can provide a query basis for the security system, asset entry and exit, and personnel entry and exit. In order to monitor the entry and exit of personnel and assets, a WiFi wireless camera is installed at the front and back doors of the classroom. At the same time, a WiFi wireless camera is installed inside the classroom to monitor the internal situation of the classroom in real time. These image data are transmitted to the terminal management computer through the remote radio frequency unit to provide real-time monitoring data.

Images