Smart classroom management method and device
By using cameras and wearable devices in smart classrooms to identify and remind students who have not listened to the class, the lack of reminder mechanism in the existing technology is solved, the quality of students' listening and classroom participation is improved, and the make-up support for class recording documents is provided.
Patent Information
- Application Number
- CN202411664728.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-11-20
- Publication Date
- 2025-02-28
AI Technical Summary
There is a lack of technical solutions in the existing technology to remind students of not listening to classes, which cannot improve students' listening quality.
By setting the first camera and the second camera on the smart blackboard, students who are not listening to the class are identified, and students are reminded through the first wearable device, and questions and recording in class are asked and recorded in collaboration with the smart blackboard and the second wearable device.
The quality of students' listening to lectures has been improved, students' classroom participation has been enhanced through reminder mechanisms, and students who miss classes have been helped to provide high-quality make-up classes through class recording documents.
Smart Images

Figure CN119540005A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of smart classrooms, and in particular to a smart classroom management method and device. Background Art
[0002] Smart classroom is a new educational model that relies on modern information technology to build an intelligent, efficient and interactive classroom environment to achieve personalized teaching and precise management, and improve the quality of education and teaching. Smart classroom has the following characteristics:
[0003] Integration of information technology: Utilize multimedia technology, the Internet, big data, cloud computing and other information technology means to provide rich resources and convenient tools for teaching.
[0004] Strong interactivity: Smart classrooms emphasize interaction between teachers and students and between students. Through electronic whiteboards, smart tablets and other devices, students can participate more actively in classroom discussions and activities.
[0005] Data analysis: By collecting and analyzing students’ learning data, teachers can understand students’ learning status, adjust teaching strategies in a timely manner, and optimize teaching results.
[0006] Resource sharing: Smart classrooms break the limitations of time and space and realize the sharing of educational resources. Students can access high-quality educational resources anytime and anywhere.
[0007] Efficient teaching management: Smart classroom improves the efficiency of teaching management, and teachers can more conveniently carry out classroom management, homework correction, and grade statistics.
[0008] However, the prior art lacks a technical solution for reminding students when they are not attending classes, and thus cannot improve the quality of students' lectures. Summary of the invention
[0009] The embodiments of the present invention provide a smart classroom management method and device, which improve the quality of students' lectures by identifying the situation that students are not attending classes and reminding them.
[0010] An embodiment of the present invention provides a smart classroom management method, the method comprising:
[0011] Identify students who are not attending the class through a first camera and a second camera, and remind the students who are not attending the class through a first wearable device; the first camera and the second camera are set on a smart blackboard; the first wearable device is worn by the student;
[0012] Asking questions in class through the collaboration between the smart blackboard, the first wearable device and the second wearable device, and recording the answers of the students; the second wearable device is worn by the teacher;
[0013] The classroom teaching is recorded by the smart blackboard and the second wearable device to obtain a recorded lesson file.
[0014] Furthermore, the step of identifying students who are not attending the class by using the first camera and the second camera, and reminding the students who are not attending the class by using the first wearable device, includes the following steps:
[0015] Establishing a three-dimensional coordinate system of the classroom, and numbering the seat area of each student in the three-dimensional coordinate system to obtain the three-dimensional seat number of the classroom;
[0016] Establishing a first association relationship between the three-dimensional seat number and the student name, and establishing a second association relationship between the student name and the first wearable device;
[0017] Recognize the face of each student in the classroom by using the first camera and the second camera to determine whether the student is attending the class; the first camera and the second camera are set in the smart blackboard;
[0018] Sending the three-dimensional seat number of the student judged as no to the control center of the smart blackboard, and forming a student list with the name of the student judged as no and sending it to the second wearable device;
[0019] The control center searches out all the first wearable devices corresponding to the three-dimensional seat number according to the first association relationship and the second association relationship, and sends a first instruction to the wearable device, so that the first wearable device reminds the student according to the first instruction.
[0020] Furthermore, the step of recognizing the face of each student in the classroom by using the first camera and the second camera to determine whether the student is attending the class includes the following steps:
[0021] Using a first camera to acquire a first image of the classroom, the first image being a global image;
[0022] The first image is partitioned according to the seating areas of the students to obtain a number of partitioned images, and facial recognition is simultaneously performed on the several partitioned images to detect whether the face of each of the students is in an abnormal facial state; the abnormal facial state includes yawning, daze and sleeping.
[0023] For the student detected as having an abnormal facial state, obtaining the coordinates of the center point of the seat area of the student;
[0024] The second camera rotates a corresponding angle according to the center point coordinates, recognizes faces of people in the seat area corresponding to the center point coordinates, and determines whether the students are attending the class.
[0025] Furthermore, the corresponding rotation angle includes a horizontal rotation angle and a vertical rotation angle.
[0026] Furthermore, asking questions in class through the collaboration between the smart blackboard, the first wearable device and the second wearable device, and recording the answers of the students, includes the following steps:
[0027] The teacher sends a quick answer instruction to the first wearable device through the second wearable device, so that the first wearable device displays a quick answer interface. After the student taps the first wearable device to answer, the first wearable device sends the quick answer instruction to the smart blackboard;
[0028] After receiving the first answering instruction, the smart blackboard announces the student name corresponding to the first answering instruction by voice;
[0029] The student's answer process and results are recorded in the classroom report through the smart blackboard.
[0030] Furthermore, the students conduct classroom audio-visual learning through a third wearable device; the third wearable device is a hardware device that provides a three-dimensional audio-visual experience.
[0031] Furthermore, the student performs classroom audio-visual learning through a third wearable device, including the following steps:
[0032] After the teacher selects an audio-visual scene on the second wearable device, the second wearable device sends the audio-visual scene ID corresponding to the audio-visual scene to the control center and the third wearable device, so that the third wearable device loads the corresponding audio-visual scene according to the scene number;
[0033] The student enters the corresponding audio-visual scene through the third wearable device, and the control center downloads the corresponding question bank according to the scene number, and randomly selects questions from the question bank and voice broadcasts the questions through the voice device of the smart blackboard;
[0034] The control center controls the first wearable device to enter a quick-answer interface, and the student taps the first wearable device to answer the question.
[0035] Furthermore, the types of the audio-visual scenes include but are not limited to humanistic scenes, geographical scenes, biological scenes and experimental scenes.
[0036] Furthermore, the reminder includes one vibration lasting a certain period of time, two vibrations with different vibration intensities, and two vibrations with the same vibration intensity.
[0037] Based on the above method embodiment, the present invention provides a corresponding device embodiment;
[0038] An embodiment of the present invention provides a smart classroom management device, including a class listening status recognition module, a class questioning module, and a class recording module;
[0039] The class attendance status recognition module is used to identify students who are not attending the class through the first camera and the second camera, and remind the students who are not attending the class through the first wearable device; the first camera and the second camera are set on the smart blackboard; the first wearable device is worn by the student;
[0040] The classroom questioning module is used to ask classroom questions through the collaboration between the smart blackboard, the first wearable device and the second wearable device, and record the student's answer results; the second wearable device is worn by the teacher;
[0041] The class recording module is used to record classroom teaching through the smart blackboard and the second wearable device to obtain a class recording file.
[0042] The following beneficial effects are achieved by implementing the embodiments of the present invention:
[0043] The embodiment of the present invention provides a smart classroom management method and device, wherein the method identifies students who are not attending the class by setting up dual cameras, and reminds the students through a first wearable device. At the same time, a second wearable device is set to receive a list of students who are not attending the class, so as to remind the teacher to understand the current class situation, so as to adjust the teaching plan in time when the quality of class is poor, so as to improve the quality of class. At the same time, the method records the classroom teaching through the smart blackboard and the second wearable device to obtain a recorded class file, thereby improving the recording quality of the recorded class file to help students who are absent from class to make up for the high-quality lessons. BRIEF DESCRIPTION OF THE DRAWINGS
[0044] Figure 1 It is a flowchart of a smart classroom management method provided by an embodiment of the present invention.
[0045] Figure 2 It is a flowchart of identifying students who have not attended classes provided by an embodiment of the present invention.
[0046] Figure 3 It is a structural diagram of a smart classroom management device provided by one embodiment of the present invention. DETAILED DESCRIPTION
[0047] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
[0048] See also Figure 1 , is a flow chart of a smart classroom management method provided by an embodiment of the present invention, including:
[0049] Step S1: Identify students who are not attending class through the first camera and the second camera, and remind the students who are not attending class through the first wearable device.
[0050] In a preferred embodiment, see Figure 2 , the step S1 comprises the following steps:
[0051] Step S11: Establish a three-dimensional coordinate system of the classroom, and number the seat area of each student in the three-dimensional coordinate system to obtain the three-dimensional seat number of the classroom. Specifically, when establishing the three-dimensional coordinate system of the classroom, the first camera is used as the origin, the right side of the student facing the podium is the positive direction of the x-axis, the back side of the student facing the podium is the positive direction of the y-axis, and the vertically upward direction is the positive direction of the z-axis.
[0052] Step S12: Establish a first association relationship between the three-dimensional seat number and the student name, and simultaneously establish a second association relationship between the student name and the first wearable device.
[0053] Step S13: The face of each student in the classroom is recognized by the first camera and the second camera to determine whether the student is attending the class; the first camera and the second camera are set in the smart blackboard.
[0054] In a preferred embodiment, the step S13 comprises the following steps:
[0055] Step S131: using a first camera to obtain a first image of the classroom, where the first image is a global image.
[0056] Step S132: partitioning the first image according to the seating areas of the students to obtain a number of partitioned images, and simultaneously performing facial recognition on the several partitioned images to detect whether the face of each of the students is in an abnormal facial state; the abnormal facial state includes yawning, daze and sleeping.
[0057] Step S133: For the student whose facial state is detected as abnormal, the center point coordinates of the seat area of the student are obtained.
[0058] Step S134: the second camera rotates a corresponding angle according to the center point coordinates, recognizes the face of the person in the seat area corresponding to the center point coordinates, and determines whether the student is attending the class; the corresponding rotation angle includes a horizontal rotation angle and a vertical rotation angle.
[0059] The horizontal rotation angle α is calculated according to formula (1):
[0060]
[0061] Among them, F ix represents the x-coordinate of the center point of the three-dimensional seat numbered i, F iy Represents the y coordinate of the center point of the three-dimensional seat numbered i.
[0062] The vertical rotation angle β is calculated according to formula (2):
[0063]
[0064] Among them, F iz represents the z coordinate of the center point of the three-dimensional seat number i, H s It represents the average height of the student's seated height above the tabletop.
[0065] In a preferred embodiment, the face recognition in the seat area corresponding to the center point coordinates to determine whether the student is attending the class includes the following steps:
[0066] Step S1341: For the face positioning key unit of the seat area corresponding to the center point coordinate, the eye image, mouth image and head image of the face area are intercepted according to the key unit. After the expression area image is subjected to highlight equalization processing, a grayscale image of the expression area image is obtained. The key unit includes an eye unit, a mouth unit and a head contour unit. In this embodiment, the key unit is used to intercept the face area so that the facial expression state can be analyzed more accurately.
[0067] Step S1342: For the eye image, use an eye state classifier to identify blinking actions, and record the first duration of the blink; for the mouth image, determine whether it is a yawning action; for the head image, detect whether it is a deflection action, a swaying action, and a pitching action, and record the second duration of the deflection action, the swaying action, or the pitching action.
[0068] Step S1343: Weight the detection results of the eye image, mouth image and head image, calculate the state abnormality value, and when the state abnormality value exceeds the preset first threshold, judge the student as not attending the class. The detection result includes the first duration, whether it is a yawning action and the second duration, and the corresponding weights are set in advance for the first duration, whether it is a yawning action and the second duration.
[0069] In this embodiment, accurate identification of students who are not attending classes can be achieved by setting up dual cameras. After the first camera preliminarily identifies the students who are not attending classes, the second camera is called to accurately identify the students who are not attending classes identified by the first camera again, so as to ensure accurate identification of students who are not attending classes and reduce the possibility of identification errors. In this embodiment, a three-dimensional coordinate system of the classroom is established and the seat area of each student in the three-dimensional coordinate system is numbered to help the dual cameras to accurately locate the students who are not attending classes, thereby further improving the accuracy of identification.
[0070] Sub-step S14: sending the three-dimensional seat number of the student judged as no to the control center of the smart blackboard, and forming a student list with the name of the student judged as no and sending it to the second wearable device; the second wearable device calculates the real-time attendance rate according to the student list. In this embodiment, the list of students who have not attended the class is sent to the second wearable device, so that the teacher can understand the quality of classroom teaching and the students' attendance status, and it is convenient for the teacher to adjust the teaching method in time.
[0071] Sub-step S15: The control center searches for all the first wearable devices corresponding to the three-dimensional seat number according to the first association relationship and the second association relationship, and sends a first instruction to the wearable device, so that the first wearable device reminds the student according to the first instruction. The reminder is specifically a regular vibration, including a vibration lasting a certain period of time, two vibrations with different vibration intensities, two vibrations with the same vibration intensities, and a vibration with alternating strong and weak vibrations.
[0072] Step S2: Ask questions in class through the collaboration between the smart blackboard, the first wearable device and the second wearable device, and record the answers of the students; the second wearable device is worn by the teacher. The first wearable device and the second wearable device are smart electronic devices worn on the wrist and have a display screen, such as smart watches.
[0073] In a preferred embodiment, step S2 comprises the following steps:
[0074] Step S21: The teacher sends a quick answer instruction to the first wearable device through the second wearable device, so that the first wearable device displays a quick answer interface. After the student taps the first wearable device to answer, the first wearable device sends the quick answer instruction to the smart blackboard.
[0075] Step S22: After receiving the first quick-answer instruction, the smart blackboard voice broadcasts the student name corresponding to the first quick-answer instruction.
[0076] Step S23: Record the student's answer process and results into a classroom report via the smart blackboard.
[0077] Step S3: Recording the classroom teaching through the smart blackboard and the second wearable device to obtain a recorded lesson file.
[0078] In a preferred embodiment, step S3 comprises the following steps:
[0079] Step S31: The smart blackboard retrieves the course schedule for the day, and records the screen of the smart blackboard regularly according to the course schedule to obtain a first video file; the course schedule for this semester is entered into the smart blackboard in advance, and for temporarily changed courses, the supplementary recording function is called to supplement the temporarily changed courses into the smart blackboard and replace the original course schedule at the corresponding time point.
[0080] Step S32: according to the course schedule, the first camera is started to perform panoramic recording of the classroom to obtain a second video file.
[0081] Step S33: The smart blackboard records the first system sound and the first classroom sound while recording the screen.
[0082] Step S34: When the screen recording starts, the smart blackboard obtains the device ID of the second wearable device according to the name of the teacher of the class corresponding to the course schedule, and sends a recording instruction to the third wearable device according to the device ID of the second wearable device, so that the third wearable device starts recording to obtain the sound of the second classroom.
[0083] Step S35: When the smart blackboard stops recording, a stop recording instruction is sent to the third wearable device to make the third wearable device stop recording.
[0084] Step S36: After the screen recording is completed, the first teacher's voice and the smart blackboard sound in the first classroom sound are identified, and the second teacher's voice in the second classroom sound is identified.
[0085] Step S37: Replace the first teacher voice in the first classroom sound according to the second teacher voice, and replace the smart blackboard sound in the first classroom sound according to the first system sound to obtain the third classroom sound.
[0086] Step S38: Match the third classroom sound to the first video file and the second video file to obtain the first recorded class file and the second recorded class file of the class. Store the first recorded class file and the second recorded class file in a corresponding system, such as an online teaching system, a make-up class system, etc. When an absent student needs to make up a class, the first classroom file and the second classroom file are played simultaneously in the corresponding system, and the first classroom file and the second classroom file are allocated corresponding proportions in the screen according to the screen ratio selected by the absent student in the corresponding system.
[0087] In a preferred embodiment, the smart classroom management method of the present invention further includes step S4: the student performs classroom audio-visual learning through a third wearable device; the third wearable device is a hardware device that provides a three-dimensional audio-visual experience.
[0088] Specifically, step S4 includes the following steps:
[0089] Step S41: After the teacher selects an audio-visual scene on the second wearable device, the second wearable device sends the audio-visual scene ID corresponding to the audio-visual scene to the control center and the third wearable device, so that the third wearable device loads the corresponding audio-visual scene according to the scene number. Preferably, the third wearable device is a VR device.
[0090] Step S42: The student enters the corresponding audio-visual scene through the third wearable device, and the control center downloads the corresponding question bank according to the scene number, and randomly selects questions from the question bank and voice broadcasts the questions through the voice device of the smart blackboard. The corresponding audio-visual scene types are divided according to different subjects, and the audio-visual scene types include but are not limited to humanities scenes, geographical scenes, biological scenes and experimental scenes.
[0091] Step S43: The control center controls the first wearable device to enter the quick answer interface, and the student taps the first wearable device to answer. When the student taps the first wearable device, a first quick answer signal is sent to the control center, and the control center determines the student who successfully answers based on the first device ID of the first wearable device corresponding to the first quick answer signal received first.
[0092] Optionally, the step S4 further includes the following steps:
[0093] Step S44: The student's answer result is recorded. A successful answer is scored as a point, and a correct answer is scored as b points. The a point and the b point are added together and counted into the student's classroom performance score.
[0094] Step S45: Synchronize the classroom performance points to the second wearable device.
[0095] In step 4, students can experience the knowledge points involved in the class by wearing the third wearable device. At the same time, through the dual experience of vision and hearing, the knowledge to be learned becomes easier to understand, more interesting and easier to remember. In step 4, voice broadcasting and questioning are performed through the voice device of the smart blackboard, so that the students can watch the audio-visual scene while thinking about the audio-visual scene, so as to enhance the interactivity and fun of the class and deepen the students' understanding and memory of knowledge points.
[0096] In a preferred embodiment, the smart classroom management method of the present invention further includes step S5: one-to-one detection of whether the student carries a mobile phone through a mobile phone detection device in the first wearable device. The mobile phone detection device includes a control circuit, a first reel, a second reel, a receiving coil and a transmitting coil, the receiving coil is wound on the surface of the first reel, and the transmitting coil is wound on the surface of the second reel.
[0097] Specifically, step S5 includes the following steps:
[0098] Step S51: the transmitting coil transmits a first electromagnetic signal of a preset changing frequency to enable a mobile phone within a certain distance to generate a second electromagnetic signal of a corresponding frequency.
[0099] Step S52: receiving the second electromagnetic signal through the receiving coil and transmitting it to the control circuit, so that the control circuit measures the phase shift between the first electromagnetic signal and the second electromagnetic signal through the electronic circuit of the phase demodulator.
[0100] Step S53: When it is determined that the phase shift exceeds a preset first threshold, the first wearable device reminds the student by vibrating and popping up an alarm message, and sends the student's name to the second wearable device and the control center. A reasonable value can be preset for the first threshold so that the detection of the mobile phone is limited to a certain distance, that is, limited to the seat area where the first wearable device is located, and the distance is the width of the seat area.
[0101] In an embodiment of the present invention, when the transmitting coil transmits the first electromagnetic signal of variable frequency, it will cause the metal object within a certain distance to generate eddy current, and then generate the second electromagnetic signal of the corresponding frequency. There is a certain phase shift between the first electromagnetic signal and the second electromagnetic signal, and the phase shift has the following characteristics: the phase shift obtained by transmitting the first electromagnetic signal to a metal material with a large resistance value will be smaller, and the phase shift measured by transmitting the first electromagnetic signal to a metal material with a small resistance value will be larger. At the same time, there is a large amount of copper on the circuit board of the mobile phone, but keys, coins, etc. are mainly made of iron. Therefore, by comparing the measured phase shift with the average phase shift of a certain type of metal, the purpose of detecting whether a mobile phone is carried can be achieved.
[0102] In a preferred embodiment, the classroom report includes a first classroom report and a second classroom report. The first classroom report is formed for the current class, and the second classroom report is formed for the students in the current class. The first classroom report includes the question number, the knowledge points involved in the question, the number of answers to a single question, whether the answer is correct, the total number of questions asked, the total number of answers, the correctness of answering questions, the note text, the key text, the number of people carrying mobile phones, the list of students who did not attend the class and the corresponding number of times they did not attend the class, and the classroom performance scores of all students. The first classroom report is recorded in the dimension of the class, and the second classroom report is recorded in the dimension of a single student. The note text and the key text are generated based on the second classroom sound.
[0103] The second classroom report includes the number of quick responses, the number of correct answers, the number of incorrect answers, the number of unanswered questions, the number of missed classes, the number of yawns, the numbers of incorrectly answered questions and the corresponding knowledge points, the numbers of correctly answered questions and the corresponding knowledge points, whether a mobile phone is brought, the number of missed classes, and the classroom performance score.
[0104] The first classroom report is sent to the second wearable device, and the second classroom report is sent to the first wearable device.
[0105] Based on the above method embodiment, a corresponding device embodiment is provided;
[0106] See also Figure 3 ,Another embodiment of the present invention provides a smart classroom management device, including a class listening status recognition module, a class questioning module and a class recording module;
[0107] The class attendance status recognition module is used to identify students who are not attending the class through the first camera and the second camera, and remind the students who are not attending the class through the first wearable device; the first camera and the second camera are set on the smart blackboard; the first wearable device is worn by the student;
[0108] The classroom questioning module is used to ask classroom questions through the collaboration between the smart blackboard, the first wearable device and the second wearable device, and record the student's answer results; the second wearable device is worn by the teacher;
[0109] The class recording module is used to record the classroom teaching through the smart blackboard and the second wearable device to obtain a class recording file;
[0110] It can be understood that the above-mentioned device item embodiments correspond to the method item embodiments of the present invention, and can implement the smart classroom management provided by any of the above-mentioned method item embodiments of the present invention.
[0111] It should be noted that the device embodiments described above are merely schematic, wherein the units / modules described as separate components may or may not be physically separated, and the components displayed as units / modules may or may not be physical units / modules, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the scheme of this embodiment. In addition, in the accompanying drawings of the device embodiments provided by the present invention, the connection relationship between the modules indicates that there is a communication connection between them, which may be specifically implemented as one or more communication buses or signal lines. A person of ordinary skill in the art may understand and implement it without creative work. The schematic diagram is only an example of a control device for a display, and does not constitute a limitation on the control device for the display, and may include more or fewer components than shown in the figure, or a combination of certain components, or different components.
[0112] The above are preferred embodiments of the present invention. It should be noted that, for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the principles of the present invention. These improvements and modifications are also considered to be within the scope of protection of the present invention.
Claims
1. A smart classroom management method, characterized in that: The management method comprises: Identify students who are not attending the class through a first camera and a second camera, and remind the students who are not attending the class through a first wearable device; the first camera and the second camera are set on a smart blackboard; the first wearable device is worn by the student; Asking questions in class through the collaboration between the smart blackboard, the first wearable device and the second wearable device, and recording the answers of the students; the second wearable device is worn by the teacher; The classroom teaching is recorded by the smart blackboard and the second wearable device to obtain a recorded lesson file.
2. The smart classroom management method according to claim 1, characterized in that: The method of identifying students who are not attending the class by using the first camera and the second camera, and reminding the students who are not attending the class by using the first wearable device, includes the following steps: Establishing a three-dimensional coordinate system of the classroom, and numbering the seat area of each student in the three-dimensional coordinate system to obtain the three-dimensional seat number of the classroom; Establishing a first association relationship between the three-dimensional seat number and the student name, and establishing a second association relationship between the student name and the first wearable device; Recognize the face of each student in the classroom by using the first camera and the second camera to determine whether the student is attending the class; the first camera and the second camera are set in the smart blackboard; Sending the three-dimensional seat number of the student judged as no to the control center of the smart blackboard, and forming a student list with the name of the student judged as no and sending it to the second wearable device; The control center searches out all the first wearable devices corresponding to the three-dimensional seat number according to the first association relationship and the second association relationship, and sends a first instruction to the wearable device, so that the first wearable device reminds the student according to the first instruction.
3. The smart classroom management method according to claim 2, characterized in that: The step of recognizing the face of each student in the classroom by using the first camera and the second camera to determine whether the student is attending the class includes the following steps: Using a first camera to acquire a first image of the classroom, the first image being a global image; The first image is partitioned according to the seating areas of the students to obtain a number of partitioned images, and facial recognition is simultaneously performed on the several partitioned images to detect whether the face of each of the students is in an abnormal facial state; the abnormal facial state includes yawning, daze and sleeping. For the student detected as having an abnormal facial state, obtaining the coordinates of the center point of the seat area of the student; The second camera rotates a corresponding angle according to the center point coordinates, recognizes faces of people in the seat area corresponding to the center point coordinates, and determines whether the students are attending the class.
4. The smart classroom management method according to claim 3, characterized in that: The corresponding rotation angles include a horizontal rotation angle and a vertical rotation angle.
5. The smart classroom management method according to claim 4, characterized in that: Asking questions in class through the collaboration between the smart blackboard, the first wearable device and the second wearable device, and recording the answer results of the students, includes the following steps: The teacher sends a quick answer instruction to the first wearable device through the second wearable device, so that the first wearable device displays a quick answer interface. After the student taps the first wearable device to answer, the first wearable device sends the quick answer instruction to the smart blackboard; After receiving the first answering instruction, the smart blackboard announces the student name corresponding to the first answering instruction by voice; The student's answer process and results are recorded in the classroom report through the smart blackboard.
6. The smart classroom management method according to claim 5, characterized in that: The students conduct classroom audio-visual learning through a third wearable device; the third wearable device is a hardware device that provides a three-dimensional audio-visual experience.
7. The smart classroom management method according to claim 6, characterized in that: The student conducts classroom audio-visual learning through a third wearable device, including the following steps: After the teacher selects an audio-visual scene on the second wearable device, the second wearable device sends the audio-visual scene ID corresponding to the audio-visual scene to the control center and the third wearable device, so that the third wearable device loads the corresponding audio-visual scene according to the scene number; The student enters the corresponding audio-visual scene through the third wearable device, and the control center downloads the corresponding question bank according to the scene number, and randomly selects questions from the question bank and voice broadcasts the questions through the voice device of the smart blackboard; The control center controls the first wearable device to enter a quick-answer interface, and the student taps the first wearable device to answer the question.
8. The smart classroom management method according to claim 7, characterized in that: The types of the audio-visual scenes include but are not limited to humanities scenes, geographical scenes, biological scenes and experimental scenes.
9. The smart classroom management method according to any one of claims 1 to 8, characterized in that: The reminder includes one vibration lasting a certain time, two vibrations with different vibration intensities, and two vibrations with the same vibration intensity.
10. A smart classroom management device, characterized in that: It includes a lecture status recognition module, a classroom questioning module and a lecture recording module; The class attendance status recognition module is used to identify students who are not attending the class through the first camera and the second camera, and remind the students who are not attending the class through the first wearable device; the first camera and the second camera are set on the smart blackboard; the first wearable device is worn by the student; The classroom questioning module is used to ask classroom questions through the collaboration between the smart blackboard, the first wearable device and the second wearable device, and record the student's answer results; the second wearable device is worn by the teacher; The class recording module is used to record classroom teaching through the smart blackboard and the second wearable device to obtain a class recording file.
Citation Information
Patent Citations
Intelligent parking lot management system and method based on multipath camera depth learning
CN107967817A
Mobile robot dual-camera face recognition device and method
CN108124090A
Teaching management method and system based on video recognition
CN109523441A
English class interaction system and mode based on wearable equipment
CN110197603A
Dual-camera classroom inspection method and system
CN110647842A