Auxiliary teaching device and system based on artificial intelligence

Abstract

The invention relates to the technical field of neck health detection, in particular to an artificial intelligence-based auxiliary teaching device and system, which comprises a control box, a pickup and a plurality of headphones, the plurality of headphones are in communication connection with the control box through a network, the pickup is in communication connection with the control box through the network, the pickup is worn by a teacher, and the control box is in communication connection with the control box through the network. The plurality of headphones are worn by students, and the sound pick-up picks up the voice of a teacher, processes the voice through the control box, and feeds the processed voice back to each headphone. The device and the system can well assist a teacher in teaching, can ensure that each student can clearly hear audio during teaching, and can monitor the state of the student in real time, for example, when the student needs to look towards a platform, the student lowers the head, a prompt can be generated, when the student needs to look towards a book or a computer, the head posture of the student is incorrect, and the student cannot hear the audio clearly. And a prompt is also generated.

Description

Technical Field

[0001] The present invention relates to the technical field of teaching systems, and in particular to an auxiliary teaching device and system based on artificial intelligence. Background Art

[0002] At present, the auxiliary teaching for students is generally to record videos and then play them with multimedia. For on-site teaching, the auxiliary teaching equipment also includes some loudspeakers worn by teachers. However, there are usually many students in the classroom. Even with loudspeakers, it cannot be guaranteed that every student can hear clearly. Moreover, these devices have single functions and very little auxiliary capabilities.

[0003] Therefore, an auxiliary teaching device and system based on artificial intelligence are proposed. Summary of the invention

[0004] The purpose of the present invention is to provide an auxiliary teaching device and system based on artificial intelligence in order to solve the above problems.

[0005] The present invention achieves the above-mentioned purpose through the following technical scheme, an auxiliary teaching device based on artificial intelligence, including: a control box, a microphone and a plurality of headphones, the plurality of headphones are connected to the control box through a network, the microphone is connected to the control box through a network, the microphone is worn by a teacher, and the plurality of headphones are worn by students. The microphone picks up the teacher's voice, processes it through the control box and feeds it back to each headset.

[0006] According to one aspect of the above technical solution, it also includes an external camera, which is communicatively connected to the control box via a network, and the external camera is pointed in the direction of the teacher.

[0007] According to one aspect of the above technical solution, a camera is also installed on the control box, and the camera is pointed in the direction of the students.

[0008] According to one aspect of the above technical solution, a vibrator and a gyroscope are provided inside the headset.

[0009] According to one aspect of the above technical solution, the external camera is supported by a support rod, and the external camera has a rotation function.

[0010] According to one aspect of the above technical solution, the control box is installed on the classroom ceiling through a hanging piece.

[0011] Another object of the present invention is to provide a teaching system based on an artificial intelligence auxiliary teaching device, characterized in that it includes a data acquisition module, a data processing / analysis module, a data storage module, a student status monitoring module and a vibration control module;

[0012] The data acquisition module collects audio and video, which are then processed by the data processing / analysis module. The audio module feeds back to the earphone part in a timely manner, and the collected video is stored.

[0013] According to one aspect of the above technical solution, it also includes a cloud disk account.

[0014] According to one aspect of the above technical solution, the student status monitoring module is implemented in the following two ways:

[0015] a. When the teacher only uses voice to explain, the data collected by the gyroscope is used to determine whether the student is looking up or down, and the head-up data and head-down data are used to determine the student's status;

[0016] b. When the teacher uses voice and action to explain, the data collected by the gyroscope is used to determine whether the student is looking up or down, and the head-up data and head-down data are used to determine the student's status. At the same time, the data generated by the teacher is tracked by an external camera and compared with the student's gaze data collected by the camera to determine the student's status.

[0017] The beneficial effects of the present invention are:

[0018] This device and system can well assist teachers in teaching. During teaching, it can ensure that every student can hear the audio clearly and can monitor the student's status in real time. For example, when it is necessary to look towards the podium, but the student lowers his head, a reminder will be generated. When it is necessary to look at a book or a computer, but the student's head posture is incorrect, a reminder will also be generated. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] Figure 1 is a system block diagram of the present invention;

[0020] Figure 2 This is a system block diagram of the present invention.

[0021] In the figure: 1. control box; 2. microphone; 3. external camera; 4. headphones; 5. camera. DETAILED DESCRIPTION

[0022] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0023] An auxiliary teaching device based on artificial intelligence includes a control box 1, a microphone 2, an external camera 3 and a plurality of headphones 4. The plurality of headphones 4 are all connected to the control box 1 through a network, the microphone 2 is connected to the control box 1 through a network, the microphone 2 is worn by a teacher, and the plurality of headphones 4 are worn by students. The microphone 2 picks up the teacher's voice, processes it through the control box 1 and feeds it back to each headset 4, wherein the external camera 3 is connected to the control box 1 through a network, and the external camera 3 is aimed at the teacher. A camera 5 is also installed on the control box 1, and the camera 5 is aimed at the student. The headset 4 is equipped with a vibrator and a gyroscope inside. The external camera 3 is supported by a support rod, and the external camera 3 has a rotation function. The control box 1 is installed on the ceiling of the classroom through a suspension member.

[0024] Camera 5 is used to photograph students and is internally equipped with an attention concentration detection interactive system. The attention concentration detection interactive system collects human eyes through camera 5 and then uses the SDM detection algorithm to detect the feature points of the human eyes. The external camera 3 is equipped with an automatic target tracking system. The camera determines the position and movement direction of the target by detecting the movement in the image. This is usually achieved by comparing the differences between consecutive image frames. When the camera detects a moving object, it starts tracking the object, and the gyroscope is used to collect parameter data such as the wearer's head orientation.

[0025] When teaching, the teacher wears the microphone 2 on the collar, collects the teacher's voice in real time, performs noise reduction processing, and then feeds back to each headphone 4, so that each student can clearly hear the teaching voice. With the headphone 4, students can be more focused and will not be disturbed by others. In addition, the external camera 3 records the teaching process into video and stores it.

[0026] A teaching system based on an artificial intelligence auxiliary teaching device, comprising a data acquisition module, a data processing / analysis module, a data storage module, a student status monitoring module, a cloud disk account and a vibration control module;

[0027] The data acquisition module collects audio and video, which are then processed by the data processing / analysis module. The audio module feeds back to the earphone part in a timely manner, and the collected video is stored.

[0028] Among them, the student status monitoring module adopts the following two methods:

[0029] a. When the teacher only uses voice to explain, the data collected by the gyroscope is used to determine whether the student is looking up or down, and the head-up data and head-down data are used to determine the student's status, as follows:

[0030] When the teacher does not use a projector or a blackboard to explain, but uses a computer to teach, the students should look at their corresponding computers and the notes or textbooks on the desk, use the gyroscope to collect data parameters of the head posture, and set standard posture parameters of the head facing the computer and the desk. That is, there are two standard parameters, and the range thresholds ab of the two postures and the time threshold k for maintaining the posture are set again. When the student's real-time posture parameters deviate from the range, a vibration reminder will be generated, or when the posture is maintained for more than the time threshold k, a vibration reminder will also be generated to prevent students from being dazed.

[0031] b. When the teacher uses voice and action to explain, the data collected by the gyroscope is used to determine whether the student is looking up or down, and the head-up data and head-down data are used to determine the student's status. At the same time, the data generated by the teacher is tracked by the external camera 3 and compared with the student's gaze data collected by the camera to determine the student's status. The details are as follows:

[0032] When the teacher uses a projector or a blackboard to explain, the teacher will walk in front of the projector or the blackboard to explain, and the external camera 3 will track the teacher to shoot, while the students should look up to the teacher, the computer and the desk. At this time, the SDM detection algorithm is used to detect the feature points of the human eye, and the optimal solution of the feature points is found after multiple iterations, so as to determine the six feature points of the left / right eye, and the center point of the human eye contour is located by using geometric knowledge, and then the image gradient information is used to obtain the center position of the iris, and the least squares ellipse fitting algorithm is used to fit the human eye contour, and then the open and closed state of the human eye is determined according to the aspect ratio of the fitted ellipse;

[0033] If the aspect ratio is less than the set opening threshold, the human eye is in a closed state, and the output is that the human eye is closed; if the aspect ratio is greater than the set opening threshold, the human eye is in an open state, and the process jumps to calculating the distance between the center point of the human eye contour and the actual pupil, and comparing the distance with the given center radius. When the distance is less than the given center radius, the output is that the human eye sight area is "middle"; when the distance is greater than the given center radius, it is determined that the human eye sight area is not in the "middle", and the process jumps to the next step;

[0034] If the aspect ratio is less than or equal to the given critical threshold, the sight area is located at "lower left" or "lower right", and the distance and relative position between the center point x0 of the human eye contour and the actual pupil position x are compared. When XX0+0.4*b, the human eye sight area is output as "lower left" and the duration is recorded; b is the short semi-axis length of the iris;

[0035] If the aspect ratio is greater than the given critical threshold, the sight area is located at "upper left" or "upper right", and the distance and relative position between the center point of the human eye contour and the actual pupil position are compared. When XX0+0.4*b, the human eye sight area is output as "upper left" and the duration is recorded;

[0036] The vibration prompt module is a vibration structure, and each seat in each classroom is equipped with a vibration structure.

[0037] At the same time, the gyroscope is used to collect data parameters of head posture, and standard posture parameters of the head facing the computer and the desk are set. That is, there are two standard parameters, and the range thresholds ab of the two postures and the time threshold k for maintaining the posture are set again. When the student's real-time posture parameters deviate from the range, a vibration reminder will be generated, or when the posture is maintained for more than the time threshold k for maintaining the posture, a vibration reminder will also be generated to prevent students from being dazed.

[0038] In addition, it should be understood that although the present specification is described according to implementation modes, not every implementation mode contains only one independent technical solution. This description of the specification is only for the sake of clarity. Those skilled in the art should regard the specification as a whole. The technical solutions in each embodiment may also be appropriately combined to form other implementation modes that can be understood by those skilled in the art.

Claims

1. An auxiliary teaching device based on artificial intelligence, characterized in that: include: A control box (1), a microphone (2) and a plurality of headphones (4), wherein the plurality of headphones (4) are connected to the control box (1) through a network, the microphone (2) is connected to the control box (1) through a network, the microphone (2) is worn by a teacher, and the plurality of headphones (4) are worn by students, and the microphone (2) picks up the teacher's voice, processes it through the control box (1) and feeds it back to each headphone (4).

2. The artificial intelligence-based auxiliary teaching device according to claim 1, characterized in that: It also comprises an external camera (3), wherein the external camera (3) is communicatively connected with the control box (1) via a network, and the external camera (3) is aimed in the direction of the teacher.

3. The artificial intelligence-based auxiliary teaching device according to claim 2, characterized in that: A camera (5) is also mounted on the control box (1), and the camera (5) is aimed in the direction of the students.

4. The artificial intelligence-based auxiliary teaching device according to claim 1, characterized in that: The headset (4) is equipped with a vibrator and a gyroscope inside.

5. The artificial intelligence-based auxiliary teaching device according to claim 2, characterized in that: The external camera (3) is supported by a support rod, and the external camera (3) has a rotation function.

6. The artificial intelligence-based auxiliary teaching device according to claim 3, characterized in that: The control box (1) is installed on the classroom ceiling via a hanging piece.

7. A teaching system based on an artificial intelligence-assisted teaching device according to any one of claims 1 to 6, characterized in that: It includes data acquisition module, data processing / analysis module, data storage module, student status monitoring module and vibration control module; The data acquisition module collects audio and video, which are then processed by the data processing / analysis module. The audio module feeds back to the earphone part in a timely manner, and the collected video is stored.

8. The teaching system based on the artificial intelligence auxiliary teaching device according to claim 7, characterized in that: It also includes cloud disk accounts.

9. The teaching system based on the artificial intelligence auxiliary teaching device according to claim 7, characterized in that: The student status monitoring module is implemented in the following two ways: a. When the teacher only uses voice to explain, the data collected by the gyroscope is used to determine whether the student is looking up or down, and the head-up data and head-down data are used to determine the student's status; b. When the teacher uses voice and action to explain, the data collected by the gyroscope is used to determine whether the student is looking up or down, and the head-up data and head-down data are used to determine the student's status. At the same time, the external camera (3) is used to track the data generated by the teacher and compare it with the student's gaze data collected by the camera to determine the student's status.

Images