Online education image signal intelligent analysis system

Through the online education image signal intelligent analysis system, dynamic control equipment and recurrent neural network model are used to solve the problem of teacher image gap, real-time analysis of image quality and improvement of transmission efficiency, and the teaching effect of online education is improved.

CN118918513AInactive Publication Date: 2024-11-08ZHENJIANG LINQIAO DIGITAL TECHNOLOGY CO LTD
View PDF 0 Cites 1 Cited by

Patent Information

Application Number
CN202411237482.2
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-09-05
Publication Date
2024-11-08
Estimated Expiration
Not applicable · inactive patent

AI Technical Summary

Technical Problem

The existing online education technology lacks image analysis and management mechanisms, which leads to a large gap between teachers' image and actual image in video playback, affecting the teaching effect.

Method used

An online educational image signal intelligent analysis system was designed, and the shooting frame rate and the mean of signal-to-noise ratio were set through dynamic control equipment. Combined with continuous operating devices, the circular neural network model was used to intelligently judge the degree of appearance deviation of teachers, providing real-time Image quality analysis.

Benefits of technology

It realizes the balance of saving and overall quality of image transmission data, and at the same time, it avoids damage to the teacher's image through intelligent judgment, and improves the image quality and teaching effect of online education videos.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118918513A_ABST
    Figure CN118918513A_ABST
Patent Text Reader

Abstract

The invention relates to an online education image signal intelligent analysis system, and the system comprises a dynamic control device which is used for setting the shooting frame rate of an online education video in a current time interval; the device is continuously operated; the method comprises the following steps: setting the number of pixel points occupied by an occupied area of an online teacher and appearance data of the occupied area; and setting the resolution of the standard graph corresponding to the online teacher and setting the appearance data of the standard graph corresponding to the online teacher, and intelligently judging and setting the appearance deviation degree data corresponding to the online teacher by adopting a recurrent neural network model. The online education image signal intelligent analysis system is stable in operation and intelligent in design. The continuous operation device which is designed in a targeted manner can be constructed and is used for intelligently judging the shape deviation degree data corresponding to the set online teacher according to the visual information of the occupied area in the image obtained by the set online teacher after the targeted enhancement processing of the current online education video image; therefore, the image of the online education teacher is prevented from being damaged.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of online education, and in particular to an online education image signal intelligent analysis system. Background Art

[0002] With the advent of the knowledge economy, people's learning patterns have been hit unprecedentedly, and various new learning patterns have emerged like a tide. Among all learning patterns, the most impactful one is the network learning that has emerged with the development of network technology, also known as online education. It is a new way of online education by establishing an education platform on the Internet and students using the Internet to conduct online education. This online education method is a brand-new learning environment composed of multimedia network learning resources, online learning communities and network technology platforms. Compared with other learning patterns, it has incomparable advantages. Specifically, online education makes it easier to achieve one-to-one communication between learning and teaching, more fully respects students' personalities, stimulates learning motivation, and is not restricted by time, place, and space, and can achieve the same interaction as in reality.

[0003] At present, the image requirements for online education teachers are getting higher and higher. In order to ensure the video playback effect of online education, the online education management party will select teachers with better images for online teaching on the one hand, and require teachers to manage their personal image on the other hand to ensure a good teacher image that finally appears on the video playback screen of the student client. However, due to poor management of the teacher's personal image, camera parameter errors and / or transmission channel interference, the teacher image that finally appears on the video playback screen of the student client is quite different from the teacher image that should be. Obviously, the existing technology lacks corresponding image analysis mechanism and image management mechanism. Summary of the invention

[0004] In order to solve the technical problems in the prior art, the present invention provides an online education image signal intelligent analysis system, which uses a dynamic control device to set the shooting frame rate of the current time interval of the online education video. The shooting frame rate of the current time interval is monotonically inversely correlated with the mean values ​​of the signal-to-noise ratios corresponding to the video images of the online education video in the previous time interval of the current time interval, thereby taking into account both image transmission data flow saving and overall image quality. Subsequently, a targeted continuous operation device is constructed for intelligently judging the appearance deviation degree data corresponding to the set online teacher according to the various visual information of the occupied area of ​​the set online teacher in the image obtained after the targeted enhancement processing of the current online education video image, thereby providing key data for real-time analysis of the image quality of the online education video.

[0005] According to the present invention, there is provided an online education image signal intelligent analysis system, the system comprising: A dynamic control device for setting a shooting frame rate of a current time interval of an online education video, wherein the shooting frame rate is monotonically inversely correlated with a mean value of each signal-to-noise ratio corresponding to each video image of the online education video in a time interval before the current time interval; An image capture device is used to capture the video image of the current moment of the online education video as an instant education image, wherein the current time interval of the online education video takes the current moment as a starting time point; a first enhancement device, connected to the image capture device, for performing a histogram equalization process based on a distribution function on the received instant education image to obtain and output a corresponding first enhanced image; a second enhancement device, connected to the first enhancement device, configured to successively perform adaptive recursive filtering processing and impulse noise elimination processing on the received first enhanced image, so as to obtain and output a corresponding second enhanced image; A third enhancement device, connected to the second enhancement device, configured to successively perform contrast enhancement processing and morphological processing on the received second enhanced image to obtain and output a corresponding third enhanced image; a continuous operation device connected to the third enhancement device, used to receive the third enhanced image and comprising a gradient acquisition unit, a model building unit and a model application unit, wherein the model application unit is respectively connected to the gradient acquisition unit and the model application unit, wherein the continuous operation device is used to detect the occupied area of ​​the set online teacher in the third enhanced image according to the brightness value interval corresponding to the set online teacher, and to use a recurrent neural network model to intelligently judge the shape deviation degree data corresponding to the set online teacher based on the number of pixels occupied by the occupied area, the shape data of the occupied area, the resolution of the standard figure corresponding to the set online teacher, and the shape data of the standard figure corresponding to the set online teacher, wherein the intelligent judgment uses a recurrent neural network that has been trained multiple times, and the shape data is the curvature data that appears the most times on the edge curve of the corresponding occupied area or the standard figure; The continuous operation device is used to detect the occupied area of ​​the online teacher in the third enhanced image according to the brightness value interval corresponding to the online teacher, including: the online teacher is set as the main teacher in the online education video in the current time interval, and the brightness value interval corresponding to the online teacher is numerically limited by the brightness upper limit threshold and the brightness lower limit threshold corresponding to the online teacher; Among them, the shooting frame rate of the current time interval of the online education video is set, and the shooting frame rate is monotonically inversely correlated with the mean of the signal-to-noise ratios corresponding to each video image of the online education video in the time interval before the current time interval, including: the current time interval and its previous time interval have the same duration.

[0006] It can be seen that the present invention has at least the following significant substantive features: Firstly: a dynamic control device is used to set the shooting frame rate of the current time interval of the online education video. The shooting frame rate of the current time interval is monotonically inversely correlated with the mean values ​​of the signal-to-noise ratios of the video images of the online education video in the previous time interval of the current time interval, thereby taking into account both image transmission data flow saving and overall image quality; Secondly: construct a targetedly designed continuous operation device for executing the intelligent judgment of the appearance distortion of the online teacher, the continuous operation device includes a gradient acquisition unit, a model building unit and a model application unit, and the model application unit is connected to the gradient acquisition unit and the model application unit respectively; Thirdly: according to the brightness value interval corresponding to the set online teacher, the occupied area of ​​the set online teacher in the image obtained after the targeted enhancement processing of the current online education video image is detected, and based on the number of pixels occupied by the occupied area, the shape data of the occupied area, the resolution of the set standard graphic corresponding to the set online teacher, and the shape data of the set standard graphic corresponding to the set online teacher, a recurrent neural network model is used to intelligently determine the shape deviation degree data corresponding to the set online teacher, thereby providing key data for real-time analysis of the image quality of the online education video; Finally: Specifically, the intelligent judgment adopts a recurrent neural network that has been trained multiple times, and the shape data is the curvature data that appears most frequently on the edge curve of the corresponding occupied area or standard figure, thereby ensuring the reliability and stability of the intelligent judgment results.

[0007] The online education image signal intelligent analysis system of the present invention has stable operation and intelligent design. Since a targeted continuous operation device can be constructed to intelligently judge the appearance deviation degree data corresponding to the set online teacher according to various visual information of the occupied area of ​​the set online teacher in the image obtained after the targeted enhancement processing of the current online education video image, the image of the online education teacher is prevented from being damaged. BRIEF DESCRIPTION OF THE DRAWINGS

[0008] The embodiments of the present invention will be described below with reference to the accompanying drawings, wherein: Figure 1 1 is an internal structure diagram of an online education image signal intelligent analysis system according to a first embodiment of the present invention.

[0009] Figure 2 1 is an internal structure diagram of an online education image signal intelligent analysis system according to a second embodiment of the present invention.

[0010] Figure 3 1 is an internal structure diagram of an online education image signal intelligent analysis system according to a third embodiment of the present invention. DETAILED DESCRIPTION

[0011] The implementation scheme of the online education image signal intelligent analysis system of the present invention will be described in detail below with reference to the accompanying drawings.

[0012] Figure 1 The internal structure diagram of the online education image signal intelligent analysis system according to the first embodiment of the present invention is shown, and the system includes: A dynamic control device for setting a shooting frame rate of a current time interval of an online education video, wherein the shooting frame rate is monotonically inversely correlated with a mean value of each signal-to-noise ratio corresponding to each video image of the online education video in a time interval before the current time interval; For example, a dynamic control device is used to set a shooting frame rate of a current time interval of an online education video, wherein the shooting frame rate is monotonically inversely correlated with the mean of each signal-to-noise ratio corresponding to each video image of the online education video in a time interval before the current time interval, including: using a numerical conversion function to represent a numerical conversion relationship of monotonically inversely correlated with the mean of each signal-to-noise ratio corresponding to each video image of the online education video in a time interval before the current time interval; An image capture device is used to capture the video image of the current moment of the online education video as an instant education image, wherein the current time interval of the online education video takes the current moment as a starting time point; a first enhancement device, connected to the image capture device, for performing a histogram equalization process based on a distribution function on the received instant education image to obtain and output a corresponding first enhanced image; a second enhancement device, connected to the first enhancement device, configured to successively perform adaptive recursive filtering processing and impulse noise elimination processing on the received first enhanced image, so as to obtain and output a corresponding second enhanced image; A third enhancement device, connected to the second enhancement device, configured to successively perform contrast enhancement processing and morphological processing on the received second enhanced image to obtain and output a corresponding third enhanced image; a continuous operation device connected to the third enhancement device, used to receive the third enhanced image and comprising a gradient acquisition unit, a model building unit and a model application unit, wherein the model application unit is respectively connected to the gradient acquisition unit and the model application unit, wherein the continuous operation device is used to detect the occupied area of ​​the set online teacher in the third enhanced image according to the brightness value interval corresponding to the set online teacher, and to use a recurrent neural network model to intelligently judge the shape deviation degree data corresponding to the set online teacher based on the number of pixels occupied by the occupied area, the shape data of the occupied area, the resolution of the standard figure corresponding to the set online teacher, and the shape data of the standard figure corresponding to the set online teacher, wherein the intelligent judgment uses a recurrent neural network that has been trained multiple times, and the shape data is the curvature data that appears the most times on the edge curve of the corresponding occupied area or the standard figure; The continuous operation device is used to detect the occupied area of ​​the online teacher in the third enhanced image according to the brightness value interval corresponding to the online teacher, including: the online teacher is set as the main teacher in the online education video in the current time interval, and the brightness value interval corresponding to the online teacher is numerically limited by the brightness upper limit threshold and the brightness lower limit threshold corresponding to the online teacher; Among them, the shooting frame rate of the current time interval of the online education video is set, and the shooting frame rate is monotonically inversely correlated with the mean values ​​of the signal-to-noise ratios of the video images of the online education video in the previous time interval of the current time interval, including: the current time interval and the previous time interval have the same duration; Among them, the shooting frame rate of the current time interval of the online education video is set, and the shooting frame rate is monotonically inversely correlated with the mean values ​​of the signal-to-noise ratios corresponding to the video images of the online education video in the time interval before the current time interval, and also includes: the smaller the mean values ​​of the signal-to-noise ratios corresponding to the video images of the online education video in the time interval before the current time interval, the greater the value of the shooting frame rate.

[0013] Figure 2 1 is an internal structure diagram of an online education image signal intelligent analysis system according to a second embodiment of the present invention.

[0014] exist Figure 2 In, with Figure 1 Differently, the online education image signal intelligent analysis system shown in the second embodiment of the present invention may also include: An on-site storage device, connected to the first enhancement device, the second enhancement device, the third enhancement device and the continuous operation device respectively, and used to provide data temporary storage services for the first enhancement device, the second enhancement device, the third enhancement device and the continuous operation device in a time-sharing manner; The on-site storage device is connected to the first enhancement device, the second enhancement device, the third enhancement device and the continuous operation device respectively, and is used to provide data temporary storage services for the first enhancement device, the second enhancement device, the third enhancement device and the continuous operation device in a time-sharing manner, including: the first enhancement device, the second enhancement device, the third enhancement device and the continuous operation device are connected to the on-site storage device respectively using different data channels; Among them, the field storage device is respectively connected to the first enhancement device, the second enhancement device, the third enhancement device and the continuous operation device, and is used to provide data temporary storage services for the first enhancement device, the second enhancement device, the third enhancement device and the continuous operation device in a time-sharing manner, including: the first enhancement device, the second enhancement device, the third enhancement device and the continuous operation device use the same reference clock signal.

[0015] Figure 3 1 is an internal structure diagram of an online education image signal intelligent analysis system according to a third embodiment of the present invention.

[0016] exist Figure 3 In, with Figure 1 Differently, the online education image signal intelligent analysis system shown in the third embodiment of the present invention may also include: a content display device, connected to the first enhancement device, the second enhancement device, the third enhancement device and the continuous operation device, respectively, and used to simultaneously display various status information of the first enhancement device, the second enhancement device, the third enhancement device and the continuous operation device; The content display device is connected to the first enhancement device, the second enhancement device, the third enhancement device and the continuous operation device respectively, and is used to simultaneously display various status information of the first enhancement device, the second enhancement device, the third enhancement device and the continuous operation device, including: the various status information of the first enhancement device, the second enhancement device, the third enhancement device and the continuous operation device displayed simultaneously includes the sleep state or working state of the first enhancement device, the second enhancement device, the third enhancement device and the continuous operation device; Wherein, the content display device is connected to the first enhancement device, the second enhancement device, the third enhancement device and the continuous operation device respectively, and is used to simultaneously display various status information of the first enhancement device, the second enhancement device, the third enhancement device and the continuous operation device, and further includes: the content display device is a liquid crystal display screen or an LED display array; and wherein the content display device is connected to the first enhancement device, the second enhancement device, the third enhancement device and the continuous operation device respectively, and is used to simultaneously display various status information of the first enhancement device, the second enhancement device, the third enhancement device and the continuous operation device, and further comprises: the LED display array is composed of a plurality of LED display units arranged in a rectangular matrix pattern; And wherein, the content display device is respectively connected to the first enhancement device, the second enhancement device, the third enhancement device and the continuous operation device, and is used to simultaneously display various status information of the first enhancement device, the second enhancement device, the third enhancement device and the continuous operation device, and also includes: the structure of the multiple LED display units arranged in a rectangular matrix pattern is the same.

[0017] In addition, in the online education image signal intelligent analysis system, the shooting frame rate of the current time interval of the online education video is set, and the shooting frame rate is monotonically inversely correlated with the mean values ​​of the signal-to-noise ratios corresponding to the video images of the online education video in the time interval before the current time interval. It also includes: using a numerical mapping function to represent the numerical mapping relationship of the monotonically inverse correlation between the shooting frame rate and the mean values ​​of the signal-to-noise ratios corresponding to the video images of the online education video in the time interval before the current time interval.

[0018] Although the preferred embodiment of the present invention has been illustrated and described, it should be understood that the present invention is not limited thereto. Numerous modifications, changes, variations, substitutions and equivalents will occur to those skilled in the art without departing from the spirit and scope of the present invention as defined by the claims.

Claims

1. An online education image signal intelligent analysis system, characterized in that: The system comprises: A dynamic control device for setting a shooting frame rate of a current time interval of an online education video, wherein the shooting frame rate is monotonically inversely correlated with a mean value of each signal-to-noise ratio corresponding to each video image of the online education video in a time interval before the current time interval; An image capture device is used to capture the video image of the current moment of the online education video as an instant education image, wherein the current time interval of the online education video takes the current moment as a starting time point; a first enhancement device, connected to the image capture device, for performing a histogram equalization process based on a distribution function on the received instant education image to obtain and output a corresponding first enhanced image; a second enhancement device, connected to the first enhancement device, configured to successively perform adaptive recursive filtering processing and impulse noise elimination processing on the received first enhanced image, so as to obtain and output a corresponding second enhanced image; A third enhancement device, connected to the second enhancement device, configured to successively perform contrast enhancement processing and morphological processing on the received second enhanced image to obtain and output a corresponding third enhanced image; a continuous operation device connected to the third enhancement device, used to receive the third enhanced image and comprising a gradient acquisition unit, a model building unit and a model application unit, wherein the model application unit is respectively connected to the gradient acquisition unit and the model application unit, wherein the continuous operation device is used to detect the occupied area of ​​the set online teacher in the third enhanced image according to the brightness value interval corresponding to the set online teacher, and to use a recurrent neural network model to intelligently judge the shape deviation degree data corresponding to the set online teacher based on the number of pixels occupied by the occupied area, the shape data of the occupied area, the resolution of the standard figure corresponding to the set online teacher, and the shape data of the standard figure corresponding to the set online teacher, wherein the intelligent judgment uses a recurrent neural network that has been trained multiple times, and the shape data is the curvature data that appears the most times on the edge curve of the corresponding occupied area or the standard figure; The continuous operation device is used to detect the occupied area of ​​the online teacher in the third enhanced image according to the brightness value interval corresponding to the online teacher, including: the online teacher is set as the main teacher in the online education video in the current time interval, and the brightness value interval corresponding to the online teacher is numerically limited by the brightness upper limit threshold and the brightness lower limit threshold corresponding to the online teacher; Among them, the shooting frame rate of the current time interval of the online education video is set, and the shooting frame rate is monotonically inversely correlated with the mean of the signal-to-noise ratios corresponding to each video image of the online education video in the time interval before the current time interval, including: the current time interval and its previous time interval have the same duration.

2. The online education image signal intelligent analysis system according to claim 1, characterized in that: The shooting frame rate of the current time interval of the online education video is set. The shooting frame rate is monotonically inversely correlated with the mean values ​​of the signal-to-noise ratios corresponding to the video images of the online education video in the time interval before the current time interval, and also includes: the smaller the mean value of the signal-to-noise ratios corresponding to the video images of the online education video in the time interval before the current time interval, the larger the value of the shooting frame rate.

3. The online education image signal intelligent analysis system according to claim 2, characterized in that: The system further comprises: An on-site storage device, connected to the first enhancement device, the second enhancement device, the third enhancement device and the continuous operation device respectively, and used to provide data temporary storage services for the first enhancement device, the second enhancement device, the third enhancement device and the continuous operation device in a time-sharing manner; Among them, the on-site storage device is respectively connected to the first enhancement device, the second enhancement device, the third enhancement device and the continuous operation device, and is used to provide data temporary storage services for the first enhancement device, the second enhancement device, the third enhancement device and the continuous operation device in a time-sharing manner, including: the first enhancement device, the second enhancement device, the third enhancement device and the continuous operation device are respectively connected to the on-site storage device using different data channels.

4. The online education image signal intelligent analysis system according to claim 3, characterized in that: The field storage device is respectively connected to the first enhancement device, the second enhancement device, the third enhancement device and the continuous operation device, and is used to provide data temporary storage services for the first enhancement device, the second enhancement device, the third enhancement device and the continuous operation device in a time-sharing manner, including: the first enhancement device, the second enhancement device, the third enhancement device and the continuous operation device use the same reference clock signal.

5. The online education image signal intelligent analysis system according to claim 2, characterized in that: The system further comprises: The content display device is connected to the first enhancement device, the second enhancement device, the third enhancement device and the continuous operation device respectively, and is used to simultaneously display various status information of the first enhancement device, the second enhancement device, the third enhancement device and the continuous operation device.

6. The online education image signal intelligent analysis system according to claim 5, characterized in that: The content display device is connected to the first enhancement device, the second enhancement device, the third enhancement device and the continuous operation device, respectively, and is used to simultaneously display various status information of the first enhancement device, the second enhancement device, the third enhancement device and the continuous operation device, including: the various status information of the first enhancement device, the second enhancement device, the third enhancement device and the continuous operation device displayed simultaneously includes the sleep state or working state of the first enhancement device, the second enhancement device, the third enhancement device and the continuous operation device.

7. The online education image signal intelligent analysis system according to claim 6, characterized in that: A content display device is respectively connected to the first enhancement device, the second enhancement device, the third enhancement device and the continuous operation device, and is used to simultaneously display various status information of the first enhancement device, the second enhancement device, the third enhancement device and the continuous operation device, and also includes: the content display device is a liquid crystal display screen or an LED display array.

8. The online education image signal intelligent analysis system according to claim 7, characterized in that: The content display device is respectively connected to the first enhancement device, the second enhancement device, the third enhancement device and the continuous operation device, and is used to simultaneously display various status information of the first enhancement device, the second enhancement device, the third enhancement device and the continuous operation device, and also includes: the LED display array is composed of multiple LED display units arranged in a rectangular matrix pattern.

9. The online education image signal intelligent analysis system according to claim 8, characterized in that: The content display device is respectively connected to the first enhancement device, the second enhancement device, the third enhancement device and the continuous operation device, and is used to simultaneously display various status information of the first enhancement device, the second enhancement device, the third enhancement device and the continuous operation device, and also includes: the structure of the multiple LED display units arranged in a rectangular matrix pattern is the same.

Citation Information

Cited By

  • Video customization search system

    CN119254987A