Recording and broadcasting system
By introducing intelligent interactive tablets, camcorders and computing power modules into the recording and broadcasting system, the classroom audio and video data is collected and analyzed, and the existing recording and broadcasting system is solved, and the efficiency and accuracy of teaching management is realized.
Patent Information
- Application Number
- CN202311251042.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-09-25
- Publication Date
- 2025-03-25
AI Technical Summary
The existing recording and broadcasting system can only record classroom audio and video, rely on manual classroom analysis, and is inefficient, unable to automatically identify student behavior and teacher teaching situations, and cannot quickly generate classroom evaluation data.
Design a recording and broadcasting system, including an intelligent interactive tablet, a camcorder and a computing power module, and generate classroom evaluation data based on the processing of the computing power module, including students' classroom performance data and teachers' teaching evaluation data.
It realizes that on the basis of recording the original classroom audio and video data, the classroom performance of students and teachers is automatically analyzed and evaluated, and objective classroom analysis data is generated, which helps the school evaluate the teaching level of students and teachers and improves teaching ability according to their aptitude.
Smart Images

Figure CN119692828A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of audio and video technology, and more specifically, to a recording and broadcasting system in the field of audio and video technology. Background Art
[0002] At present, recording and broadcasting systems are becoming increasingly popular. Recording and broadcasting systems can record teachers' teaching behaviors, blackboard writing and students' classroom performance in the form of videos. Recording and broadcasting systems are generally only used in specific courses, such as open classes, remote teaching, etc. Excellent classroom video recordings are helpful for training inexperienced teachers, and regular classroom video recordings are helpful for school administrators to evaluate teachers' work ability and work results. However, the current recording and broadcasting system only records classroom audio and video, and all classroom analysis relies on manual work, which is inefficient. Summary of the invention
[0003] The present application provides a recording and broadcasting system, which can analyze the students' classroom performance and the teachers' teaching situation on the basis of recording the original audio and video data of the classroom, and form classroom analysis data, so as to help the school evaluate the students' classroom performance and the teachers' teaching level with objective data, which is conducive to improving the school's level of teaching each student in accordance with their aptitude and helping teachers improve their teaching ability.
[0004] This application specification provides a recording and broadcasting system, which includes: an intelligent interactive tablet, a camcorder and a computing module, and the intelligent interactive tablet and the camcorder are both connected to the computing module for communication; wherein:
[0005] An intelligent interactive tablet, used to collect first audio and video data about students in the classroom, obtain classroom behavior data of students based on the first audio and video data, and transmit the classroom behavior data to the computing power module;
[0006] A camcorder, used for collecting second audio and video data about the teacher in the classroom, and transmitting the second audio and video data to the computing power module;
[0007] The computing power module is used to generate classroom evaluation data based on the first audio and video data and classroom behavior data transmitted by the smart interactive tablet and the second audio and video data transmitted by the camcorder; wherein the classroom evaluation data includes students' classroom performance data and teachers' teaching evaluation data.
[0008] In one possible implementation, the computing power module is connected to the smart interactive tablet and the camcorder via a network cable, the smart interactive tablet is connected to the external network device via the network cable, the external network device is connected to the server, and the network cable has an Ethernet power supply function; the computing power module is also used to transmit classroom evaluation data and the second audio and video data to the smart interactive tablet, and the smart interactive tablet is also used to transmit the first audio and video data, the second audio and video data and classroom evaluation data to the server.
[0009] In one possible implementation, the smart interactive tablet includes: a first camera unit, a first microphone array unit, a microcomputer module and a first network switch; wherein: the first camera unit and the first microphone array unit are both connected to a common interface, the common interface is connected to the microcomputer module, the microcomputer module, the first microphone array unit and the computing power module are all connected to the first network switch via a network cable, and the microcomputer module is connected to an external network device via a network cable; the first camera unit is used to collect first video data of students and obtain classroom behavior data of students based on the first video data, and transmit the first video data and classroom behavior data to the microcomputer module; the first microphone array unit is used to collect first audio data of students and transmit the first audio data to the microcomputer module; the microcomputer module is used to generate first audio and video data based on the first video data and the first audio data, and transmit the first audio and video data and classroom behavior data to the computing power module.
[0010] In one possible implementation, the microcomputer module includes a network address translation service.
[0011] In one possible implementation, the computing power module includes: a first network interface, a second network interface, a first power module, a second power module, a second network switch, a network transceiver, a processing module and a storage module; wherein: the first network interface is connected to the first network switch via a network cable, the first power module, the second power module and the second network switch are all connected to the first network interface, the second network switch is connected to the network transceiver, the network transceiver is connected to the processing module, the processing module is connected to the storage module, the second network switch and the second power module are both connected to the second network interface, and the second network interface is connected to the camcorder via a network cable; the first power module is used to step down the voltage provided by the network cable connected to the first network interface to power the second network switch, the network transceiver, the processing module and the storage module; the second power module is used to step up the voltage provided by the network cable connected to the first network interface to power the camcorder.
[0012] In one possible implementation, the computing power module also includes: a network card module, the network card module is connected to the first power supply module and the second network switch, the interface of the network card module serves as the first network interface, and the first network interface is plugged into the first network switch.
[0013] In one possible implementation, the camcorder includes: a second camera unit, a second microphone array unit, a video processor, an audio processor, a third network switch, a third power supply module and a third network interface; wherein: the second camera unit and the audio processor are both connected to the video processor, the second microphone array unit is connected to the audio processor, the video processor and the audio processor are connected to the third network switch, the third network switch is connected to the third network interface, the third network interface is connected to the second network interface via a network cable, and the third network interface is connected to the third power supply module; the third power supply module is used to step down the voltage provided by the network cable connected to the third network interface to power the second camera unit, the second microphone array unit, the video processor, the audio processor and the third network switch; the audio processor is used to convert the second audio data of the teacher collected by the second microphone array unit into an audio text; the video processor is used to synchronize and align the second video data of the teacher collected by the second camera unit with the audio text to obtain second audio and video data, and transmit the second audio and video data to the computing power module.
[0014] In one possible implementation, the smart interactive tablet is arranged in front of the classroom, and the camcorder is arranged in the back of the classroom; the recording and broadcasting system also includes a third microphone array unit arranged on the top of the classroom, and the camcorder also includes a fourth power module and a fourth network interface; the fourth power module is connected to the third network switch via a network cable, and the fourth network interface is connected to the third microphone array unit via a network cable; the fourth power module is used to boost the voltage output by the network cable connected to the third network switch to power the third microphone array unit; the third microphone array unit is used to collect third audio data of students and teachers to expand the pickup range of the recording and broadcasting system.
[0015] In one possible implementation, the third microphone array unit transmits the third audio data to the camcorder, and the camcorder transmits the second audio data and the third audio data to the first microphone array unit through the computing module; the first microphone array unit is also used to fuse the first audio data, the second audio data and the third audio data to obtain target audio data, and transmit it to the microcomputer module through the first network switch; the microcomputer module is also used to use the target audio data to adjust the audio data in the first audio and video data and the second audio and video data, and perform audio and video synchronization alignment processing.
[0016] In one possible implementation, the computing power module is integrated into the smart interactive tablet.
[0017] The recording and broadcasting system provided by the embodiments of the present application has the following technical effects:
[0018] The recording and broadcasting system provided in the embodiment of the present application includes an intelligent interactive tablet, a camcorder and a computing power module. The computing power module is connected to the intelligent interactive tablet and the camcorder. The intelligent interactive tablet is used to collect first audio and video data about students in the classroom, and obtain students' classroom behavior data based on the first audio and video data, and transmit the classroom behavior data to the computing power module. The camcorder is used to collect second audio and video data about teachers in the classroom, and transmit the second audio and video data to the computing power module. The computing power module generates students' classroom performance data and teachers' teaching evaluation data based on the first audio and video data and classroom behavior data transmitted by the intelligent interactive tablet and the second audio and video data transmitted by the camcorder. On the basis of recording the original audio and video data of the classroom, the student's classroom performance and the teacher's teaching situation can be analyzed at the same time, and classroom analysis data can be formed, thereby helping schools to evaluate students' classroom performance and teachers' teaching level with objective data, which is conducive to improving the school's level of teaching students in accordance with their aptitude and helping teachers improve their teaching ability. BRIEF DESCRIPTION OF THE DRAWINGS
[0019] Figure 1 An exemplary block diagram of a recording and broadcasting system provided by an embodiment of the present application is shown;
[0020] Figure 2 A schematic diagram of an application scenario of a recording and broadcasting system is shown;
[0021] Figure 3 Another exemplary block diagram of a recording and broadcasting system provided by an embodiment of the present application is shown;
[0022] Figure 4 A block diagram of a smart interactive tablet is shown;
[0023] Figure 5 A block diagram of a computing power module is shown;
[0024] Figure 6 shows a block diagram of a camcorder;
[0025] Figure 7 An exemplary block diagram of another recording and broadcasting system provided by an embodiment of the present application is shown;
[0026] Figure 8 A schematic diagram of a standard classroom is shown. DETAILED DESCRIPTION
[0027] The technical solution in the present application will be described clearly and in detail below in conjunction with the accompanying drawings. In the description of the embodiments of the present application, unless otherwise specified, " / " means or, for example, A / B can mean A or B: "and / or" in the text is only a description of the association relationship of associated objects, indicating that there can be three relationships, for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, in the description of the embodiments of the present application, "multiple" means two or more than two.
[0028] In the following, the terms "first" and "second" are used for descriptive purposes only and are not to be understood as suggesting or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the features.
[0029] At present, recording and broadcasting systems are becoming increasingly popular. Recording and broadcasting systems can record teachers' teaching behaviors, blackboard writing and students' classroom performance in the form of videos. Recording and broadcasting systems are generally only used in specific courses, such as open classes, remote teaching, etc. Excellent classroom video recordings can help train inexperienced teachers, and regular classroom video recordings can help school administrators evaluate teachers' work ability and work results. However, the current recording and broadcasting system only records classroom audio and video, and all classroom analysis relies on manual labor, which has the following problems:
[0030] 1. Limited by the camera design and system processor computing power, the recording and broadcasting system cannot recognize student behaviors (such as raising hands, standing up to answer questions, etc.), cannot recognize students' faces and record student behaviors one by one; 2. Limited by the system design and processor computing power, it is difficult to statistically record student behaviors and automatically generate classroom evaluation data, and the recorded audio and video files cannot quickly locate the nodes of student behavior performance; 3. Limited by the audio collection capability and system design, it is difficult to automatically recognize the voices of students and teachers and automatically convert them into text. It can be seen that the current recording and broadcasting system lacks intelligent hardware, which requires manual participation in the entire process of classroom analysis, affecting efficiency.
[0031] Based on the above problems, this application proposes a recording and broadcasting system that can analyze students' classroom performance (for example, identifying student behavior in the classroom and matching students, recording, automatically generating student behavior files, and generating audio and video recording files) and teachers' teaching situations on the basis of recording the original audio and video data of the classroom, and form classroom analysis data, thereby helping schools to evaluate students' classroom performance and teachers' teaching level with objective data, which is conducive to improving the school's level of teaching each student in accordance with their aptitude and helping teachers improve their teaching ability.
[0032] The following is an embodiment of a recording and broadcasting system provided in an embodiment of the present application.
[0033] Figure 1 An exemplary block diagram of a recording and broadcasting system provided in an embodiment of the present application is shown. Figure 1 As shown, the recording and broadcasting system provided in the embodiment of the present application includes: an intelligent interactive tablet 100, a camcorder 200 and a computing module 300, and the computing module 300 is connected to the intelligent interactive tablet 100 and the camcorder 200. The intelligent interactive tablet 100 is used for video recording, video analysis, and video playback, and also has other functions, such as being used as a whiteboard; the camcorder 200 is used for video recording and playback, and the computing module 300 is used to process and analyze multiple audio and video data based on different algorithms.
[0034] In an exemplary embodiment, the recording and broadcasting system can be used to record videos of teachers and students in the classroom and analyze the teaching situation of teachers and students. Figure 2 As shown, Figure 2 The application scenario diagram of the recording and broadcasting system is shown. The intelligent interactive tablet 100 is set in the front of the classroom, for example, between the podium and the front blackboard, and the camcorder 200 is set in the back of the classroom, for example, between the last row of desks and the back blackboard. The location of the computing power module 300 is not required and can be set according to actual conditions.
[0035] The smart interactive tablet 100 faces the desk and is used to collect the first audio and video data about the students in the classroom, and obtain the classroom behavior data of the students based on the first audio and video data, and transmit the first audio and video data and the classroom behavior data to the computing power module 300; wherein the first audio and video data includes the audio data and video data of the students during class, the characters are mainly students, and the classroom behavior data includes the students' expressions, actions and behaviors (such as raising hands, standing up to answer questions, etc.). The camcorder 200 is also called the teacher's machine, facing the podium, and is used to collect the second audio and video data about the teacher in the classroom, and transmit the second audio and video data to the computing power module 300; wherein the second audio and video data includes the audio data and video data during the teacher's lecture, and the characters are mainly teachers. The computing power module 300 is used to generate classroom evaluation data based on the first audio and video data and classroom behavior data transmitted by the smart interactive tablet 100 and the second audio and video data transmitted by the camcorder 200, and the classroom evaluation data includes the students' classroom performance data and the teacher's teaching evaluation data.
[0036] It is understandable that the computing module 300 is pre-set with an evaluation algorithm for students and an evaluation algorithm for teachers. The first audio and video data and classroom behavior data are processed using the evaluation algorithm for students to obtain the classroom performance data of each student in this class. The classroom performance data includes the student's excellent performance evaluation, insufficient performance evaluation, classroom comprehensive performance evaluation, excellent performance moment record, insufficient performance moment record, etc. In order to more intuitively see the class situation of each student in this class, the classroom performance data can be made into a student's classroom performance portrait, and the class situation of each student is described in detail and intuitively through the student classroom portrait, which is conducive to students' self-reflection through their own student classroom portraits, and is also conducive to parents and teachers accurately understanding the student's class situation, facilitating timely intervention in students' learning, and assisting schools in teaching each student in accordance with their aptitude.
[0037] The second audio and video data is processed using the teacher evaluation algorithm to obtain the teacher's teaching evaluation data in this class, which includes the teacher's excellent performance evaluation, insufficient performance evaluation, classroom comprehensive performance evaluation, excellent performance moment record, insufficient performance moment record, etc. In order to more intuitively see the teacher's teaching situation in this class, the teaching evaluation data can be made into a teacher's teaching performance portrait, which describes each teacher's teaching situation in detail and intuitively, which is conducive to helping teachers recognize the advantages and disadvantages of their own teaching, thereby improving their teaching ability.
[0038] The recording and broadcasting system provided in the embodiment of the present application includes an intelligent interactive tablet, a camcorder and a computing power module. The computing power module is connected to the intelligent interactive tablet and the camcorder. The intelligent interactive tablet is used to collect first audio and video data about students in the classroom, and obtain students' classroom behavior data based on the first audio and video data, and transmit the classroom behavior data to the computing power module. The camcorder is used to collect second audio and video data about teachers in the classroom, and transmit the second audio and video data to the computing power module. The computing power module generates students' classroom performance data and teachers' teaching evaluation data based on the first audio and video data and classroom behavior data transmitted by the intelligent interactive tablet and the second audio and video data transmitted by the camcorder. On the basis of recording the original audio and video data of the classroom, the student's classroom performance and the teacher's teaching situation can be analyzed at the same time, and classroom analysis data can be formed, thereby helping schools to evaluate students' classroom performance and teachers' teaching level with objective data, which is conducive to improving the school's level of teaching students in accordance with their aptitude and helping teachers improve their teaching ability.
[0039] In one possible implementation, Figure 3 Another exemplary block diagram of a recording and broadcasting system provided by an embodiment of the present application is shown. Figure 3As shown, the computing power module 300 is connected to the smart interactive tablet 100 and the camcorder 200 through a network cable, the smart interactive tablet 100 is connected to the external network device 400 through a network cable, and the external network device 400 is connected to the server 300. The network cable has an Ethernet power supply function, and the Ethernet power supply function is a function related to the POE (Power Over Ethernet) technology. When applying the recording and broadcasting system, it is only necessary to provide 220V AC power to the smart interactive tablet 100. Since the smart interactive tablet 100, the camcorder 200, the computing power module 300 and the external network device 400 are all connected through a network cable, the camcorder 200, the computing power module 300 and the external network device 400 all draw power from the network cable through the POE technology to work. The physical connection between each device in the above-mentioned recording and broadcasting system is simple. All devices can be cascaded through a standard network cable to achieve power supply and communication, which not only saves the cost of equipment, but also reduces the difficulty of wiring when arranging the recording and broadcasting system.
[0040] Furthermore, the computing module 300 is also used to transmit the classroom evaluation data and the second audio and video data to the smart interactive tablet 100, and the smart interactive tablet 100 is also used to transmit the first audio and video data, the second audio and video data, and the classroom evaluation data to the server 500. It is understood that the smart interactive tablet 100 transmits the first audio and video data, the second audio and video data, and the classroom evaluation data to the server 500 for storage, and students, teachers, and parents can all access the server to understand and trace the previous students' class conditions and teachers' teaching conditions.
[0041] In one possible implementation, Figure 4 A block diagram of a smart interactive tablet is shown, such as Figure 4 As shown, the smart interactive tablet includes: a first camera unit 101, a first microphone array unit 102, a microcomputer module 103 and a first network switch 104; wherein: the first camera unit 101 and the first microphone array unit 102 are both connected to the common interface 105, and the common interface 105 is connected to the microcomputer module 103. It can be understood that the common interface 105 is, for example, a USB interface, and the first camera unit 101 and the first microphone array unit 101 share one interface to connect to the microcomputer module 103, which can save costs and simplify device connections. The microcomputer module 103, the first microphone array unit 102 and the computing power module 300 are all connected to the first network switch 104 via a network cable, and the microcomputer module 103 is connected to the external network device 400 via a network cable.
[0042] The first camera unit 101 is used to collect the first video data of the students and obtain the classroom behavior data of the students based on the first video data, that is, the first camera unit 101 identifies the student behavior in the first video data, obtains the classroom behavior data, and transmits the first video data and the classroom behavior data to the microcomputer module 103. The first microphone array unit 102 is used to collect the first audio data of the students. The microcomputer module 103 can be understood as a computer with the functions of a computer, and is used to generate the first audio and video data according to the first video data and the first audio data, and transmit the first audio and video data and the classroom behavior data to the computing power module 300. The microcomputer module 103 is also used to display the first audio and video data.
[0043] The data transmission process between the modules in the smart interactive tablet 100 is as follows: the microcomputer module 103 supplies power to the first camera unit 101 and the first microphone array unit 102; the first camera unit 101 transmits the collected video data about the students and the classroom behavior data identified based on the video data, and the first microphone array unit 102 transmits the collected audio data about the teacher and the students to the microcomputer module 103 through the public interface 105; the microcomputer module 103 processes the audio data and the video data to achieve audio and video alignment and obtain the first audio and video data; the first audio and video data and the classroom behavior data are transmitted to the computing power module 300 through the first network switch 104; the computing power module 300 generates the students' classroom performance data based on the received first audio and video data and classroom behavior data.
[0044] In a possible implementation, the microcomputer module 103 includes a network address translation service, i.e., a NAT (Network Address Translation) service. Since the microcomputer module 103 includes two network interfaces, one of which is connected to the first network switch 104 via a network cable, and the other is connected to the external network device 400 via a network cable, by enabling the NAT service, local area network isolation can be achieved, i.e., the IP network segments of the two network interfaces of the microcomputer module 103 are isolated, so that the microcomputer module 103 connects the network interface of the microcomputer module 103 with the first network switch 104, the first microphone array unit 101, the computing module 300, and the camcorder 200 to form a local area network, isolating the external network, so that the transmission and processing of audio data and video data are all carried out in the local area network, ensuring the bandwidth and network stability. Since the first microphone array unit 101 is connected to the first network switch 104 via a network cable, and the first network switch 104 is connected to the microcomputer module 103 and the computing module 300 via a network cable, when data is transmitted between the above modules, the data is transmitted via the local area network.
[0045] In one possible implementation, Figure 5 The block diagram of the computing power module is shown as follows: Figure 5 As shown in Figure A, the computing module 300 includes: a first network interface 301, a second network interface 302, a first power module 303, a second power module 304, a second network switch 305, a network transceiver 306, a processing module 307 and a storage module 308. Among them: the first network interface 301 is connected to the first network switch 104 through a network cable, the first power module 303, the second power module 304 and the second network switch 305 are all connected to the first network interface 301, the second network switch 305 is connected to the network transceiver 306, the network transceiver 360 is connected to the processing module 307, the processing module 307 is connected to the storage module 308, the second network switch 305 and the second power module 304 are both connected to the second network interface 302, and the second network interface 302 is connected to the camcorder 200 through a network cable.
[0046] The first power supply module 303 is used to step down the voltage provided by the network cable connected to the first network interface 301 to power the second network switch 305, the network transceiver 306, the processing module 307 and the storage module 308. The second power supply module 304 is used to step up the voltage provided by the network cable connected to the first network interface 301 to power the camcorder 200. The network transceiver 306 is used for receiving and transmitting data.
[0047] The data transmission process between the modules in the computing power module 300 is as follows: the data received by the first network interface 301 and the second network interface 302 are transmitted to the network transceiver 306 through the second network switch 305, and the network transceiver 306 transmits the received data to the processing module 307 for processing, and the storage module 308 stores the data. After the processing module 307 completes the data processing, the processing module 307 transmits the data to the network transceiver 306, and the network transceiver 306 transmits the received data to the first network switch 104 through the second network switch 305 and the first network interface 301 in sequence, so as to reach the intelligent switching flat panel 100, and then the intelligent switching flat panel 100 uploads the data to the server 500 through the external network device 400.
[0048] The processing process of the computing power module 300 for the first audio and video data and classroom behavior data is as follows: the first network interface 301 transmits the first audio and video data and classroom behavior data transmitted by the first network switch 104 to the network transceiver 306 through the second network switch 305, and the network transceiver 306 transmits the received first audio and video data and classroom behavior data to the processing module 307 for processing, thereby generating the student's classroom performance data, and the storage module 308 stores the student's classroom performance data.
[0049] In a possible implementation, the computing power of the processing module 307 is at least 24TOPS. Since the recording and broadcasting system is used for recording classroom videos and evaluating and analyzing the teaching situation of teachers and students, and since the total number of students and teachers is large, the processing module 307 needs to complete the evaluation and analysis of each student and teacher in the audio and video data of a class within a specified time, and it is necessary to select a processor with high computing power. In this case, a processor with a computing power of at least 24TOPS is selected as the processing module 307, thereby improving the data processing speed and shortening the data evaluation and analysis time. For the storage module 308, it is necessary to store the audio and video data and classroom evaluation data of multiple classes, and considering the erase and write life, the capacity of the storage module 308 needs to be large enough, for example, a solid-state hard disk or mechanical hard disk with a capacity of at least 128GB is selected as the storage module 308. All network interfaces involved in the recording and broadcasting system are used to connect network cables with POE function. Considering the load power consumption, each network interface needs to support the 802.3at protocol, and the external output power is at least 25W.
[0050] like Figure 5 As shown in Figure B, the computing power module 300 can be powered independently, and the computing power module 300 also includes: a network card module 301 ′ , network card module 301 ′ The network card module 301 is connected to the first power supply module 303 and the second network switch 305. ′ The interface is used as the first network interface 301 in Figure A, and the network card module 301 ′ The interface is no longer connected to the first power module 303 and the second network switch 305, and the first network interface 301 (ie, the network card module 301 ′ The network card module 301 is connected to the first network switch 104. ′ For example, it is a USB network card module. The interface of the USB network card module is a USB interface. The interface of the second network switch 305 is also a USB interface. The interface of the USB network card module is plugged into the interface of the second network switch 305, which is convenient for disassembly of the USB network card module, thereby separating the computing power module 300 from the smart interactive tablet 100 for easy installation. ′The RTL8252 / RTL8153 solution is integrated on the computing power module 300. When the interface of the USB network card module is plugged into the interface of the second network switch 305, it is equivalent to adding a new network card to the microcomputer module 103 using the USB interface.
[0051] In one possible implementation, Figure 6 A block diagram of a camcorder is shown, Figure 6 As shown, the camcorder 200 includes: a second camera unit 201, a second microphone array unit 202, a video processor 203, an audio processor 204, a third network switch 205, a third power module 206 and a third network interface 207. Among them: the second camera unit 201 and the audio processor 204 are both connected to the video processor 203, the second microphone array unit 202 is connected to the audio processor 204, the video processor 203 and the audio processor 204 are both connected to the third network switch 205 through a network cable, the third network switch 205 is connected to the third network interface 207 through a network cable, the third network interface 207 is connected to the second network interface 302 through a network cable, and the third network interface 207 is connected to the third power module 206.
[0052] The third power module 206 is used to step down the voltage provided by the network cable connected to the third network interface 207 to power the second camera unit 201, the second microphone array unit 202, the video processor 203, the audio processor 204 and the third network switch 205; the audio processor 204 is used to convert the second audio data of the teacher collected by the second microphone array unit 202 into an audio text; the video processor 203 is used to synchronize and align the second video data of the teacher collected by the second camera unit 201 with the audio text to obtain the second audio and video data, and transmit the second audio and video data to the computing power module 300. Among them, the third power module 206 is a power receiving device (PD).
[0053] The data transmission process between the modules in the camcorder 200 is as follows: the voltage output by the second network interface 302 through the network cable is used as the input voltage of the third power module 206. After the third power module 206 steps down the input voltage, it supplies power to the second camera unit 201, the second microphone array unit 202, the video processor 203, the audio processor 204 and the third network switch 205. The second camera unit 201 transmits the collected video data to the video processor 203, the second microphone array unit 202 transmits the collected audio data to the audio processor 204, the audio processor 204 converts the audio data into audio text, and transmits the audio text to the video processor 203, the video processor 203 synchronizes the audio text with the video data, outputs audio and video digital data, transmits the audio and video digital data to the third network interface 207 through the third network switch 205, and is transmitted out by the third network interface 207.
[0054] The process of collecting the second audio and video data about the teacher in the classroom through the camcorder 200 is as follows: the second camera unit 201 collects the video data about the teacher, the second microphone array unit 202 collects the audio data about the teacher, the audio processor 204 converts the audio data about the teacher into audio text, and the video processor 203 synchronizes the video data and the audio text about the teacher to generate the second audio and video data. When the second audio and video data is played, it has subtitles.
[0055] In one possible implementation, Figure 6 As shown, the recording and broadcasting system also includes a third microphone array unit 600 arranged on the top of the classroom, and the camcorder 200 also includes a fourth power module 208 and a fourth network interface 209. The fourth power module 209 is connected to the third network switch 205 via a network cable, and the fourth network interface 209 is connected to the third microphone array unit 600 via a network cable. The fourth power module 208 is used to boost the voltage output by the network cable connected to the third network switch 205 to power the third microphone array unit 600; the third microphone array unit 600 is used to collect third audio data about students and teachers to expand the pickup range of the recording and broadcasting system. Among them, the fourth power module 208 is a power supply equipment (Power Sourcing Equipment, PSE), the third power module 206 and the fourth power module 208 support the 802.3at protocol, and the third microphone array unit 600 includes n hanging microphones, n is greater than or equal to 1, such as Figure 2 As shown; wherein, n hanging microphones are connected in series via network cables.
[0056] In one possible implementation, the third microphone array unit 600 transmits the third audio data to the camcorder 200, and the camcorder 200 transmits the second audio data and the third audio data to the first microphone array unit 102 through the computing power module 300. Specifically, the third microphone array unit 600 transmits the third audio data to the fourth network interface 209, and the third audio data is transmitted to the second network interface 302 through the fourth network interface 209, the third network switch 205, and the third network interface 207 to reach the computing power module 300; the second microphone array unit 202 transmits the third audio data to the second network interface 302 through the audio processor 204, the third network switch 205, and the third network interface 207 to reach the computing power module 300; the second network interface 302 transmits the second audio data and the third audio data to the first microphone array unit 102 through the second network switch 305, the first network interface 301, and the first network switch 104. The first microphone array unit 102 is also used to perform fusion processing on the first audio data, the second audio data and the third audio data to obtain target audio data, and transmit it to the microcomputer module 103 through the first network switch 104; the microcomputer module 103 is also used to use the target audio data to adjust the audio data in the first audio and video data and the second audio and video data, and perform audio and video synchronization alignment processing. The fusion processing of the first audio data, the second audio data and the third audio data includes performing audio alignment processing, noise reduction processing, audio and character matching processing, etc. on the first audio data, the second audio data and the third audio data in time.
[0057] It can be understood that the first microphone array unit 102 is a main audio collection unit, the second microphone array unit 202 and the third microphone array unit 600 are slave audio collection units, and the first microphone array unit 102 has a data processing function. The audio data collected by the second microphone array unit 202 and the third microphone array unit 600 will be transmitted to the first microphone array unit 102 and processed by the first microphone array unit 102.
[0058] The route for the second microphone array unit 202 to transmit the collected audio data to the first microphone array unit 102 is: second microphone array unit 202-audio processor 204-third network switch 205-third network interface 207-second network interface 302-second network switch 305-first network interface 301-first network switch 104-first microphone array unit 102. The route for the third microphone array unit 600 to transmit the collected audio data to the first microphone array unit 102 is: fourth network interface 209-third network switch 205-third network interface 207-second network interface 302-second network switch 305-first network interface 301-first network switch 104-first microphone array unit 102.
[0059] Since the first microphone array unit 102, the second microphone array unit 202 and the third microphone array unit 600 are arranged at different positions, audio data at different positions can be collected, and the audio data collected by the three have the same part and different parts, and the sound volume of the audio data of the same part may be different. After the first microphone array unit 102 receives the audio data about students and teachers collected by the second microphone array unit 202 and the third microphone array unit 600, the first microphone array unit 102 processes and reduces noise on the audio data collected by itself and the audio data about students and teachers collected by the second microphone array unit 202 and the third microphone array unit 600, and filters irrelevant sounds to obtain target audio data, and then transmits the target audio data to the microcomputer module 103, and the microcomputer module 103 uses the target audio data to correct and enhance the audio data in the first audio and video data, and synchronizes the audio data and the video data, and uses the target audio data to correct and enhance the audio data in the second audio and video data, and synchronizes the audio data and the video data, and then uploads the adjusted first audio and video data and the second audio and video data to the server 500.
[0060] In one possible implementation, Figure 7 An exemplary block diagram of another recording and broadcasting system provided in an embodiment of the present application is shown. Figure 7 As shown, the computing module 300 is integrated in the smart interactive tablet 100. It can be understood that the computing module 300 is a module in the smart interactive tablet 100. Such a setting can reduce the difficulty of arranging the recording and broadcasting system and save space.
[0061] The recording and broadcasting system provided in the embodiment of the present application, on the basis of realizing classroom audio and video collection, increases the ability to analyze video and audio by setting a computing power module, thereby replacing manual analysis and evaluation of the class situation of students and teachers in each class. The design of the network architecture of the recording and broadcasting system does not affect the original network connection method of the smart interactive flat-panel in the classroom. Only one network cable is required to connect to the external network, and only one IP address of the router is occupied to make the recording and broadcasting system work, which reduces the difficulty of arranging the recording and broadcasting system and reduces the installation cost of the recording and broadcasting system.
[0062] The following are the setting standards for smart interactive tablets, camcorders and hanging microphones, as follows:
[0063] Regarding the smart interactive tablet, the first camera unit in the smart interactive tablet is mainly used for recording video data and identifying human behavior. Considering the capabilities of the sensor, the first camera unit includes at least three cameras, for example, cameras A, B and C. Figure 8 As shown, Figure 8 A schematic diagram of a standard classroom is shown. According to the national standard, the length and width of a standard classroom are 7 meters by 9 meters, and the distance between the first row of students and the blackboard is 1.7 meters. Camera A is used to record the activities of students in the entire classroom. It is calculated that the horizontal viewing angle of camera A is greater than 130 degrees. In this application, the pixel of camera A is not less than 5 million pixels, and the angle between A1 and A2 is the horizontal viewing angle of camera A. According to the requirements of the face recognition algorithm, the face pixel must be no less than 64×64 pixels. Camera A cannot meet the requirements, so cameras B and C are introduced. The horizontal viewing angle of cameras B and C is not less than 70°, and the pixels are not less than 13 million. Cameras B and C are used for face recognition and character posture recognition.
[0064] About the camcorder, such as Figure 8 As shown in the figure, since the standard classroom is 9m×7m, the width of the smart interactive flat panel and the front blackboard is 4.2m, according to the formula: tanα=w / h, where 2×α is the field of view of the camera in the camcorder, 2×w is the width of the blackboard, and h is the distance from the camera in the camcorder to the front blackboard. It can be seen that in a 9m classroom, the camera field of view needs to be greater than 13° to meet the requirements.
[0065] According to the requirements of the OCR (Optical Character Recognition) algorithm, the pixels corresponding to the captured text need to be larger than 48×48, so 4K resolution video is used to capture the blackboard. When the camcorder is 10m away from the front blackboard, it can recognize text larger than 8.9cm, which meets the requirements of most educational scenarios.
[0066] According to the specifications, the camera module of the camcorder selects the commonly used specifications of a lens with a horizontal field of view of 40° + a 48M sensor, which can cover classrooms with a length greater than 5.8m. The single microphone in the microphone array unit of the camcorder selects a microphone that supports an 8m pickup range.
[0067] Regarding hanging microphones and their specifications, it can be seen from the above that in a classroom of 10m, the smart interactive tablet plus a camcorder can fully meet the sound pickup requirements (the sound pickup range of the camcorder is 8m, and the sound pickup range of the smart interactive tablet is much greater than 2m); but in order to meet the requirements of different users, this recording and broadcasting system also supports the expansion of hanging microphones to enhance the audio effect; in order to more conveniently connect to the camcorder, the hanging microphone also needs to support POE power supply and cascading functions.
[0068] The above contents are only specific implementation methods of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.
Claims
1. A recording and broadcasting system, characterized in that: The recording and broadcasting system includes: an intelligent interactive tablet, a camcorder and a computing module, wherein the intelligent interactive tablet and the camcorder are both communicatively connected to the computing module; wherein: The smart interactive tablet is used to collect first audio and video data about students in the classroom, obtain classroom behavior data of the students based on the first audio and video data, and transmit the classroom behavior data to the computing power module; The camcorder is used to collect second audio and video data about the teacher in the classroom, and transmit the second audio and video data to the computing power module; The computing power module is used to generate classroom evaluation data based on the first audio and video data and the classroom behavior data transmitted by the smart interactive tablet and the second audio and video data transmitted by the camcorder; wherein the classroom evaluation data includes the student's classroom performance data and the teacher's teaching evaluation data.
2. The recording and broadcasting system according to claim 1, characterized in that: The computing power module is connected to the smart interactive tablet and the camcorder via a network cable, the smart interactive tablet is connected to an external network device via the network cable, the external network device is connected to a server, and the network cable has an Ethernet power supply function; The computing power module is also used to transmit the classroom evaluation data and the second audio and video data to the smart interactive tablet, and the smart interactive tablet is also used to transmit the first audio and video data, the second audio and video data and the classroom evaluation data to the server.
3. The recording and broadcasting system according to claim 2, characterized in that: The smart interactive tablet comprises: a first camera unit, a first microphone array unit, a microcomputer module and a first network switch; wherein: The first camera unit and the first microphone array unit are both connected to a common interface, the common interface is connected to the microcomputer module, the microcomputer module, the first microphone array unit and the computing power module are all connected to the first network switch via the network cable, and the microcomputer module is connected to the external network device via the network cable; The first camera unit is used to collect the first video data of the student and obtain the classroom behavior data of the student based on the first video data, and transmit the first video data and the classroom behavior data to the microcomputer module; The first microphone array unit is used to collect the first audio data of the student and transmit the first audio data to the microcomputer module; The microcomputer module is used to generate the first audio and video data according to the first video data and the first audio data, and transmit the first audio and video data and the classroom behavior data to the computing power module.
4. The recording and broadcasting system according to claim 3, characterized in that: The microcomputer module includes a network address translation service.
5. The recording and broadcasting system according to claim 3, characterized in that: The computing power module includes: a first network interface, a second network interface, a first power module, a second power module, a second network switch, a network transceiver, a processing module and a storage module; wherein: The first network interface is connected to the first network switch via the network cable, the first power module, the second power module and the second network switch are all connected to the first network interface, the second network switch is connected to the network transceiver, the network transceiver is connected to the processing module, the processing module is connected to the storage module, the second network switch and the second power module are all connected to the second network interface, and the second network interface is connected to the camcorder via the network cable; The first power supply module is used to step down the voltage provided by the network cable connected to the first network interface to supply power to the second network switch, the network transceiver, the processing module and the storage module; The second power supply module is used to boost the voltage provided by the network cable connected to the first network interface to power the camcorder.
6. The recording and broadcasting system according to claim 5, characterized in that: The computing power module also includes: a network card module, which is connected to the first power supply module and the second network switch, and the interface of the network card module serves as the first network interface, which is plugged into the first network switch.
7. The recording and broadcasting system according to claim 5, characterized in that: The camcorder includes: a second camera unit, a second microphone array unit, a video processor, an audio processor, a third network switch, a third power module and a third network interface; wherein: The second camera unit and the audio processor are both connected to the video processor, the second microphone array unit is connected to the audio processor, the video processor and the audio processor are connected to the third network switch, the third network switch is connected to the third network interface, the third network interface is connected to the second network interface via the network cable, and the third network interface is connected to the third power supply module; The third power supply module is used to step down the voltage provided by the network cable connected to the third network interface to supply power to the second camera unit, the second microphone array unit, the video processor, the audio processor and the third network switch; The audio processor is used to convert the second audio data of the teacher collected by the second microphone array unit into an audio text; The video processor is used to synchronize and align the second video data of the teacher collected by the second camera unit with the audio text to obtain the second audio and video data, and transmit the second audio and video data to the computing power module.
8. The recording and broadcasting system according to claim 7, characterized in that: The smart interactive tablet is arranged in front of the classroom, and the camcorder is arranged in the back of the classroom; The recording and broadcasting system further includes a third microphone array unit disposed on the top of the classroom, and the camcorder further includes a fourth power supply module and a fourth network interface; The fourth power supply module is connected to the third network switch via the network cable, and the fourth network interface is connected to the third microphone array unit via the network cable; The fourth power supply module is used to boost the voltage output by the network cable connected to the third network switch to supply power to the third microphone array unit; The third microphone array unit is used to collect third audio data of the students and the teacher to expand the sound pickup range of the recording and broadcasting system.
9. The recording and broadcasting system according to claim 8, characterized in that: The third microphone array unit transmits the third audio data to the camcorder, and the camcorder transmits the second audio data and the third audio data to the first microphone array unit through the computing module; The first microphone array unit is further used to perform fusion processing on the first audio data, the second audio data and the third audio data to obtain target audio data, and transmit the target audio data to the microcomputer module through the first network switch; The microcomputer module is also used to use the target audio data to adjust the audio data in the first audio and video data and the second audio and video data, and perform audio and video synchronization alignment processing.
10. The recording and broadcasting system according to any one of claim 1, characterized in that: The computing power module is integrated into the smart interactive tablet.
