Intelligent online video teaching effect management system

Abstract

The application relates to an intelligent online video teaching effect management system which comprises self-adaptive capturing devices, multiple optimization devices, target identifying devices, area storage mechanisms, visual judgment mechanisms and warning triggering mechanisms. The intelligent online video teaching effect management system is compact in structure and simple in operation.

Description

TECHNICAL FIELD

[0001] The present application relates to the field of online education, and particularly to an intelligent online video teaching effect management system. BACKGROUND

[0002] Distance education is a form of education in which students and teachers, students and educational organizations mainly use various media to carry out systematic teaching and communication. It is an education that transmits courses to one or more students outside the campus. Modern distance education refers to the transmission of courses to students outside the campus through audio, video (live or video) and computer technology, including real-time and non-real-time. Modern distance education is a new type of education that has emerged with the development of modern information technology. The development of computer technology, multimedia technology and communication technology, especially the rapid development of the Internet, has made the means of distance education have a qualitative leap, becoming distance education under the condition of high-tech. Modern distance education is mainly based on modern distance education means, compatible with traditional teaching forms such as face-to-face, correspondence and self-study, and is an optimized combination of multiple media.

[0003] CN119089045A discloses an intelligent online video teaching effect real-time enhancement method and device. The method includes: obtaining teaching effect data of a currently played teaching sub-video; comparing the teaching effect data with a set threshold value respectively; and playing a next teaching sub-video or a backup teaching sub-video of the current teaching sub-video according to the size relationship. Through the device, multiple online education videos are provided for the teaching content of the same theme, and the online education videos are dynamically selected according to the online video teaching effect, which can better improve the online video teaching effect; the online video teaching effect is mastered in real time, and the teaching method is adjusted in real time and dynamically, thereby enhancing the online video teaching effect. SUMMARY

[0004] In order to solve the above problems, the application provides a kind of intelligent online video teaching effect management system, can be based on the reference depth of view value corresponding to the image area occupied by the first human body target and the shooting focal length corresponding to the multiple optimization image estimation area of the side of the first human body target facing the imaging lens, and when the estimated area is less than the entity area of the side of the first human body target facing the imaging lens, it is judged that the first human body target is blocked by the second human body target nearby, otherwise, it is judged that the first human body target is not blocked by the second human body target nearby, and the reference depth of view value corresponding to the image area occupied by the first human body target and the shooting focal length corresponding to the multiple optimization image estimation area of the side of the first human body target facing the imaging lens include: the reference depth of view value corresponding to the image area occupied by the first human body target and the shooting focal length corresponding to the multiple optimization image are positively correlated with the estimated area of the side of the first human body target facing the imaging lens, and finally a warning trigger mechanism is used to trigger the corresponding warning operation of the student when there are two adjacent human body targets in each two adjacent human body targets in the multiple optimization image, the first human body target is blocked by the second human body target nearby, otherwise, the warning operation of the student is temporarily suspended. The corresponding warning operation of the student is implemented to realize the intelligent discipline management of the remote education environment, and the influence of the student on the education effect of the remote education is avoided.

[0005] The system comprises:

[0006] An adaptive capture device is used to perform a time-sharing picture capture operation with a set frame rate on the indoor scene of a remote classroom for performing remote education to obtain an indoor scene picture corresponding to the current time, and the value of the set frame rate is positively correlated with the indoor area of the remote classroom.

[0007] A multiple optimization device is connected with the adaptive capture device and comprises a point image restoration device, a real-time enhancement device and a sharpening processing device, which are used to continuously perform single or multiple point image restoration processing, image frequency domain enhancement processing and sharpening processing based on USM filter on the received indoor scene picture corresponding to the current time to obtain and output the corresponding multiple optimization image.

[0008] A target recognition device is connected with the multiple optimization device, which is used to identify the respective human body occupied image area corresponding to each human body target in the received multiple optimization image based on human body imaging features.

[0009] An area storage mechanism is connected with the visual judgment mechanism, which is used to pre-store the entity area of the side facing the imaging lens corresponding to each registered student of the remote classroom.

[0010] The visual judgment mechanism is connected with the area storage mechanism and the target identification device respectively, and is used for taking each two adjacent human body targets in each human body target in the multiple optimization image as a first human body target and a second human body target, obtaining each depth of field data corresponding to each constituent pixel point of the human body occupied image area of the first human body target in the received multiple optimization image, removing the maximum value and the minimum value of the each depth of field data to obtain a plurality of residual depth of field data, performing mean value processing on the plurality of residual depth of field data to obtain a reference depth of field value corresponding to the human body occupied image area of the first human body target, estimating an estimated area of the side of the first human body target facing the imaging lens based on the reference depth of field value corresponding to the human body occupied image area of the first human body target and the shooting focal length corresponding to the multiple optimization image, and judging that the first human body target is blocked by the nearby second human body target when the estimated area is smaller than the actual area of the side of the first human body target facing the imaging lens, otherwise, judging that the first human body target is not blocked by the nearby second human body target, wherein the estimating the estimated area of the side of the first human body target facing the imaging lens based on the reference depth of field value corresponding to the human body occupied image area of the first human body target and the shooting focal length corresponding to the multiple optimization image includes that the reference depth of field value corresponding to the human body occupied image area of the first human body target and the shooting focal length corresponding to the multiple optimization image are positively correlated with the estimated area of the side of the first human body target facing the imaging lens.

[0011] The warning trigger mechanism is connected with the visual judgment mechanism, and is used for triggering the corresponding warning operation of the students being too close to each other when there are two adjacent human body targets in which the first human body target is blocked by the nearby second human body target among each two adjacent human body targets in each human body target in the multiple optimization image, otherwise, the warning operation of the students being too close to each other is temporarily suspended.

[0012] The intelligent online video teaching effect management system of the application has compact structure and simple operation. The two adjacent human body targets in the remote classroom can be intelligently judged based on various visual data whether they block each other, and the corresponding warning operation of the students being too close to each other is triggered when there are two adjacent human body targets in which the first human body target is blocked by the nearby second human body target, so that the intelligent discipline management of the remote education environment is realized. DETAILED DESCRIPTION

[0013] In the process of performing remote education, if there is a scene of students being too close to each other in the remote classroom, the students can be identified as adjacent students for conversation, which will seriously affect the teaching record of the remote classroom and the learning effect of each student. However, how to finely identify the scene of students being too close to each other in the remote classroom is one of the technical problems that have not been solved in the prior art.

[0014] The implementation of the intelligent online video teaching effect management system will be described in detail below.

[0015] First embodiment

[0016] The intelligent online video teaching effect management system according to the first embodiment of the present application comprises:

[0017] An adaptive capturing device is configured to perform a time-sharing picture capturing operation with a set frame rate on an indoor scene of a remote classroom for performing remote education to obtain a picture of the indoor scene corresponding to a current time, wherein the set frame rate is positively correlated with an indoor area of the remote classroom.

[0018] For example, the adaptive capturing device configured to perform a time-sharing picture capturing operation with a set frame rate on an indoor scene of a remote classroom for performing remote education to obtain a picture of the indoor scene corresponding to a current time, wherein the set frame rate is positively correlated with an indoor area of the remote classroom comprises: the adaptive capturing device comprises a frame rate control unit, a picture capturing unit and a signal output unit, which are configured to cooperatively perform the time-sharing picture capturing operation with the set frame rate on the indoor scene of the remote classroom for performing remote education to obtain the picture of the indoor scene corresponding to the current time.

[0019] A multi-optimization device is connected with the adaptive capturing device and comprises a point image restoration device, a real-time enhancement device and a sharpening processing device, which are configured to continuously perform single or multiple point image restoration processing, image frequency domain enhancement processing and sharpening processing based on a USM filter on the received picture of the indoor scene corresponding to the current time to obtain and output a corresponding multi-optimized image.

[0020] A target recognition device is connected with the multi-optimization device and is configured to recognize each human body target corresponding to each part of the human body occupying image area in the received multi-optimized image based on human body imaging features.

[0021] An area storage mechanism is connected with the visual judgment mechanism and is configured to pre-store each part of the entity area facing the side of the imaging lens corresponding to each registered student of the remote classroom.

[0022] The visual judgment mechanism is connected with the area storage mechanism and the target identification device respectively, and is configured to: take each two adjacent human body targets in the human body targets in the multi-optimized image as a first human body target and a second human body target, obtain each depth-of-field data corresponding to each constituent pixel point of the human body occupied image area of the first human body target in the received multi-optimized image, remove the maximum value and the minimum value of the depth-of-field data to obtain a plurality of residual depth-of-field data, perform mean value processing on the plurality of residual depth-of-field data to obtain a reference depth-of-field value corresponding to the human body occupied image area of the first human body target, estimate an estimated area of the side of the first human body target facing the imaging lens based on the reference depth-of-field value corresponding to the human body occupied image area of the first human body target and the shooting focal length corresponding to the multi-optimized image, and when the estimated area is smaller than the actual area of the side of the first human body target facing the imaging lens, judge that the first human body target is blocked by the second human body target nearby, otherwise, judge that the first human body target is not blocked by the second human body target nearby, wherein the estimation of the estimated area of the side of the first human body target facing the imaging lens based on the reference depth-of-field value corresponding to the human body occupied image area of the first human body target and the shooting focal length corresponding to the multi-optimized image includes that the reference depth-of-field value corresponding to the human body occupied image area of the first human body target and the shooting focal length corresponding to the multi-optimized image are positively correlated with the estimated area of the side of the first human body target facing the imaging lens.

[0023] The warning trigger mechanism is connected with the visual judgment mechanism, and is configured to: when there are two adjacent human body targets in which the first human body target is blocked by the second human body target nearby in each two adjacent human body targets in the human body targets in the multi-optimized image, trigger the corresponding warning operation of the students being too close to each other, otherwise, temporarily suspend the execution of the warning operation of the students being too close to each other.

[0024] The multi-optimization device is connected with the adaptive capture device and includes a point image restoration device, a real-time enhancement device, and a sharpening processing device, and is configured to: continuously perform single or multiple point image restoration processing, image frequency domain enhancement processing, and sharpening processing based on a USM filter on the received indoor scene picture corresponding to the current time to obtain and output the corresponding multi-optimized image. The point image restoration device is configured to perform single or multiple point image restoration processing on the received image signal.

[0025] Second embodiment

[0026] According to the second embodiment of the present application, an intelligent online video teaching effect management system is shown.

[0027] Unlike the first embodiment, the intelligent online video teaching effect management system shown in the second embodiment of the present application can further include:

[0028] Length sensor devices, respectively connected with the target recognition device, the point image restoration device, the real-time enhancement device and the sharpening processing device, are used to measure the current real-time length values of the target recognition device, the point image restoration device, the real-time enhancement device and the sharpening processing device respectively;

[0029] In the application, the length sensor devices, respectively connected with the target recognition device, the point image restoration device, the real-time enhancement device and the sharpening processing device, are used to measure the current real-time length values of the target recognition device, the point image restoration device, the real-time enhancement device and the sharpening processing device respectively, which includes that the length sensor devices include a plurality of length measurement units, which are respectively connected with the target recognition device, the point image restoration device, the real-time enhancement device and the sharpening processing device to complete the measurement of the current real-time length values of the target recognition device, the point image restoration device, the real-time enhancement device and the sharpening processing device respectively.

[0030] In the application, the length sensor devices, respectively connected with the target recognition device, the point image restoration device, the real-time enhancement device and the sharpening processing device, are used to measure the current real-time length values of the target recognition device, the point image restoration device, the real-time enhancement device and the sharpening processing device respectively, which includes that the length sensor devices include a plurality of length measurement units, which are respectively connected with the target recognition device, the point image restoration device, the real-time enhancement device and the sharpening processing device to complete the measurement of the current real-time length values of the target recognition device, the point image restoration device, the real-time enhancement device and the sharpening processing device respectively.

[0031] In the application, the length sensor devices, respectively connected with the target recognition device, the point image restoration device, the real-time enhancement device and the sharpening processing device, are used to measure the current real-time length values of the target recognition device, the point image restoration device, the real-time enhancement device and the sharpening processing device respectively, which includes that the length sensor devices include a plurality of length measurement units, which are respectively connected with the target recognition device, the point image restoration device, the real-time enhancement device and the sharpening processing device to complete the measurement of the current real-time length values of the target recognition device, the point image restoration device, the real-time enhancement device and the sharpening processing device respectively.

[0032] In the application, the length sensor devices, respectively connected with the target recognition device, the point image restoration device, the real-time enhancement device and the sharpening processing device, are used to measure the current real-time length values of the target recognition device, the point image restoration device, the real-time enhancement device and the sharpening processing device respectively, which includes that the length sensor devices include a plurality of length measurement units, which are respectively connected with the target recognition device, the point image restoration device, the real-time enhancement device and the sharpening processing device to complete the measurement of the current real-time length values of the target recognition device, the point image restoration device, the real-time enhancement device and the sharpening processing device respectively.

[0033] Third embodiment

[0034] The intelligent online video teaching effect management system is shown according to the third embodiment of the present application.

[0035] Different from the first embodiment, the intelligent online video teaching effect management system shown according to the third embodiment of the present application can further include:

[0036] A length display mechanism connected with the multiple length measurement units of the target recognition device, the point image restoration device, the real-time enhancement device and the sharpening processing device respectively, for synchronously displaying the current real-time length values of the target recognition device, the point image restoration device, the real-time enhancement device and the sharpening processing device respectively;

[0037] The length display mechanism connected with the multiple length measurement units of the target recognition device, the point image restoration device, the real-time enhancement device and the sharpening processing device respectively, for synchronously displaying the current real-time length values of the target recognition device, the point image restoration device, the real-time enhancement device and the sharpening processing device respectively includes that the length display mechanism is a touch display screen;

[0038] The length display mechanism connected with the multiple length measurement units of the target recognition device, the point image restoration device, the real-time enhancement device and the sharpening processing device respectively, for synchronously displaying the current real-time length values of the target recognition device, the point image restoration device, the real-time enhancement device and the sharpening processing device respectively includes that the length display mechanism is a non-touch display screen.

[0039] In addition, in the intelligent online video teaching effect management system, the multiple optimization device connected with the adaptive capturing device and including the point image restoration device, the real-time enhancement device and the sharpening processing device, for continuously performing single or multiple point image restoration processing, image frequency domain enhancement processing and sharpening processing based on USM filter on the received indoor scene picture corresponding to the current time to obtain and output the corresponding multiple optimization image, further includes that the real-time enhancement device is used for performing image frequency domain enhancement processing on the received image signal;

[0040] The multiple optimization device connected with the adaptive capturing device and including the point image restoration device, the real-time enhancement device and the sharpening processing device, for continuously performing single or multiple point image restoration processing, image frequency domain enhancement processing and sharpening processing based on USM filter on the received indoor scene picture corresponding to the current time to obtain and output the corresponding multiple optimization image further includes that the sharpening processing device is used for performing sharpening processing based on USM filter on the received image signal.

[0041] The technical innovation and the generated technical effects of the technical solution of the present application are as follows:

[0042] Firstly, obtain the respective depth of field data corresponding to each constituent pixel point of the human body occupied image area of the first human body target in the received multiple optimization images, remove the maximum and minimum values of the respective depth of field data to obtain a plurality of remaining depth of field data, and perform mean value processing on the plurality of remaining depth of field data to obtain a reference depth of field value corresponding to the human body occupied image area of the first human body target.

[0043] Secondly, based on the reference depth of field value corresponding to the human body occupied image area of the first human body target and the shooting focal length corresponding to the multiple optimization images, estimate the estimated area of the side of the first human body target facing the imaging lens, and when the estimated area is less than the actual area of the side of the first human body target facing the imaging lens, judge that the first human body target is blocked by the nearby second human body target, otherwise, judge that the first human body target is not blocked by the nearby second human body target.

[0044] Thirdly, based on the reference depth of field value corresponding to the human body occupied image area of the first human body target and the shooting focal length corresponding to the multiple optimization images, estimating the estimated area of the side of the first human body target facing the imaging lens includes that the reference depth of field value corresponding to the human body occupied image area of the first human body target and the shooting focal length corresponding to the multiple optimization images are positively correlated with the estimated area of the side of the first human body target facing the imaging lens.

[0045] Finally, the warning triggering mechanism is used to trigger the corresponding warning operation of the students being too close when there are two adjacent human body targets in which the first human body target is blocked by the nearby second human body target among each two adjacent human body targets in the multiple optimization images, otherwise, the corresponding warning operation of the students being too close is temporarily suspended, so as to realize the intelligent discipline management of the remote education environment and avoid the influence of the students being too close on the education effect of the remote education.

[0046] Although the content considered as the preferred embodiments of the present application has been described, those skilled in the art will realize that other and further modifications can be made without departing from the spirit of the present application, and it is intended to claim the right of all such embodiments falling within the true scope of the present application.

Claims

1. An intelligent online video teaching effect management system, characterized in that, The system comprises: An adaptive capturing device, configured to perform a frame rate setting time-sharing picture capturing operation on an indoor scene of a remote classroom for performing remote education, to obtain a picture of the indoor scene corresponding to a current time, and a value of the frame rate is positively correlated with an indoor area of the remote classroom; A multi-optimization device, connected with the adaptive capturing device and comprising a point image restoration device, a real-time enhancement device, and a sharpening processing device, configured to continuously perform single or multiple point image restoration processing, image frequency domain enhancement processing, and USM filter based sharpening processing on the received picture of the indoor scene corresponding to the current time, to obtain and output a corresponding multi-optimized image; The real-time enhancement device is configured to perform image frequency domain enhancement processing on the received image signal, and the sharpening processing device is configured to perform USM filter based sharpening processing on the received image signal; The point image restoration device is configured to perform single or multiple point image restoration processing on the received image signal; A target identification device, connected with the multi-optimization device, configured to identify, based on human body imaging features, each of the human body targets in the received multi-optimized image to correspond to a respective human body occupied image area; An area storage mechanism, connected with the visual judgment mechanism, configured to pre-store an entity area of a side facing the imaging lens corresponding to each of the registered students in the remote classroom; A visual judgment mechanism, connected with the area storage mechanism and the target identification device, configured to take each of two adjacent human body targets in the multi-optimized image as a first human body target and a second human body target, obtain each of the depth of field data corresponding to each of the constituent pixels of the human body occupied image area of the first human body target in the received multi-optimized image, remove the maximum and minimum values of the depth of field data to obtain a plurality of remaining depth of field data, perform mean value processing on the plurality of remaining depth of field data to obtain a reference depth of field value corresponding to the human body occupied image area of the first human body target, estimate an estimated area of the side of the first human body target facing the imaging lens based on the reference depth of field value corresponding to the human body occupied image area of the first human body target and a shooting focal length corresponding to the multi-optimized image, and when the estimated area is smaller than an entity area of the side of the first human body target facing the imaging lens, judge that the first human body target is occluded by the nearby second human body target, otherwise, judge that the first human body target is not occluded by the nearby second human body target, wherein the reference depth of field value corresponding to the human body occupied image area of the first human body target and the shooting focal length corresponding to the multi-optimized image are positively correlated with the estimated area of the side of the first human body target facing the imaging lens; An alarm triggering mechanism, connected with the visual judgment mechanism, configured to trigger a corresponding alarm operation of the students being too close when there are two adjacent human body targets in which the first human body target is occluded by the nearby second human body target among each of the two adjacent human body targets in the multi-optimized image, otherwise, temporarily suspend the alarm operation corresponding to the students being too close.

2. The intelligent online video instruction effect management system of claim 1, wherein, The system further comprises: Length sensor devices, respectively connected with the target recognition device, the point image restoration device, the real-time enhancement device and the sharpening processing device, for measuring current real-time length values of the target recognition device, the point image restoration device, the real-time enhancement device and the sharpening processing device respectively; The length sensor devices include a plurality of length measurement units, respectively connected with the target recognition device, the point image restoration device, the real-time enhancement device and the sharpening processing device, for measuring current real-time length values of the target recognition device, the point image restoration device, the real-time enhancement device and the sharpening processing device respectively. 3.The intelligent online video teaching effect management system of claim 2, wherein: The plurality of length measurement units are a plurality of length sensors, respectively connected with the target recognition device, the point image restoration device, the real-time enhancement device and the sharpening processing device, for measuring current real-time length values of the target recognition device, the point image restoration device, the real-time enhancement device and the sharpening processing device respectively. 4.The intelligent online video teaching effect management system of claim 3, wherein: The plurality of length sensors have the same structure. 5.The intelligent online video teaching effect management system of claim 4, wherein: The plurality of length sensors have the same length measurement upper limit value and length measurement lower limit value.

6. The intelligent online video teaching effect management system according to any one of claims 2-5, wherein, The system further comprises: Length display mechanisms, respectively connected with the plurality of length measurement units of the target recognition device, the point image restoration device, the real-time enhancement device and the sharpening processing device, for synchronously displaying current real-time length values of the target recognition device, the point image restoration device, the real-time enhancement device and the sharpening processing device respectively. 7.The intelligent online video teaching effect management system of claim 6, wherein: The length display mechanisms are touch display screens. 8.The intelligent online video teaching effect management system of claim 6, wherein: The length display mechanisms are non-touch display screens.