Method and system for monitoring video education

Abstract

According to an embodiment of the present invention, provided is a method for monitoring video education by a service server, the method comprising the steps of: transmitting, to student terminals, lecture images received from a lecturer terminal and receiving a face image of each student captured in real time from each student terminal and a student name received from each student terminal; transmitting, to the lecturer terminal, an image including a plurality of sections each consisting of the name and the face image of a student; and determining, for each section, that the corresponding student is continuously away if the time during which the face image of the student is not recognized lasts for a first threshold time or more.

Description

Video Education Monitoring Method and System

[0001] The present invention relates to a video education monitoring method and system, and more specifically, to a video education monitoring method and system that enables education records, attendance management, and concentration analysis.

[0002] With the development of information and communication technology and the expansion of the private education market, online educational methods, namely remote lectures (Internet education), are becoming widespread.

[0003] In particular, due to recent circumstances such as the epidemic, these remote lectures are becoming increasingly popular.

[0004] Traditional remote lectures relied on providing pre-recorded video lectures, which had the limitation of allowing students to learn passively by watching only the footage. To overcome this limitation, systems are recently evolving in a direction that enables real-time interaction between students and teachers, allowing them to listen to lectures and ask questions immediately (much like video chat).

[0005] However, in such conventional remote lecture methods, instructors could not monitor students' learning attitudes in real time. Currently, student engagement could only be assessed based on attendance checks or whether the lecture was completed; however, students exploited these limitations to engage in other activities during playback, leading to problems.

[0006] In addition, there was a problem where it was impossible to accurately verify students' attendance.

[0007] Therefore, technology capable of checking attendance and monitoring concentration is needed even in video education.

[0008] The present invention is intended to solve the problems of the prior art.

[0009] The objective of the present invention is to enable clear determination of each student's attendance status, absence status, etc., in video education.

[0010] The objective of the present invention is to enable the determination of each student's level of concentration during a lecture in video education.

[0011] The objectives of the present invention are not limited to those mentioned above, and other unmentioned objectives will be clearly understood from the description below.

[0012] According to one embodiment of the present invention for achieving the above-described purpose, a video education monitoring method is provided, comprising: a service server, as a method for monitoring video education, transmitting a lecture video received from an instructor terminal to a student terminal and receiving a face image of each student captured in real time from the student terminal and a student name received from the student terminal; transmitting a video to the instructor terminal that includes a plurality of sections each consisting of a student's name and a student's face image; and, in each section, if the time during which a student's face image is not recognized persists for longer than a first threshold time, determining that there is no consecutive seat for the student.

[0013] The above video education monitoring method may further include a step of determining that there is no accumulated space for a student in each section if the accumulated time during which the student's face image is not recognized is greater than or equal to a second threshold time.

[0014] The above second threshold time may be set to be inversely proportional to the number of times it is determined that there are no consecutive digits.

[0015] According to one embodiment of the present invention, in video education, it is possible to clearly determine the attendance status, absence status, etc., of each student.

[0016] According to one embodiment of the present invention, in video education, it is possible to determine the level of concentration of each student during the lecture.

[0017] FIG. 1 is a diagram schematically showing the configuration of a video education monitoring system according to one embodiment of the present invention.

[0018] FIG. 2 is a block diagram illustrating the detailed configuration and functions of a service providing server according to an embodiment of the present invention.

[0019] FIG. 3 is a drawing showing an example of a real-time face capture video of students according to an embodiment of the present invention.

[0020] FIG. 4 illustrates an example of transmitting information regarding each student's absence status and no attendance record status according to an embodiment of the present invention.

[0021] The following detailed description of the invention refers to the accompanying drawings, which illustrate specific embodiments in which the invention may be practiced. These embodiments are described in sufficient detail to enable those skilled in the art to practice the invention. It should be understood that various embodiments of the invention are different but need not be mutually exclusive. For example, specific shapes, structures, and characteristics described herein with respect to one embodiment may be implemented in other embodiments without departing from the spirit and scope of the invention. It should also be understood that the location or arrangement of individual components within each disclosed embodiment may be changed without departing from the spirit and scope of the invention. Accordingly, the following detailed description is not intended to be limiting, and the scope of the invention is limited only by the appended claims, including all equivalents to those claimed therein, provided appropriately described. Similar reference numerals in the drawings refer to the same or similar functions across various aspects.

[0022] Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the attached drawings in order to enable a person skilled in the art to easily practice the present invention.

[0023] FIG. 1 is a diagram schematically showing the configuration of a video education monitoring system according to one embodiment of the present invention.

[0024] Referring to FIG. 1, a system according to an embodiment of the present invention may be configured to include a student terminal (100), an instructor terminal (200), and a service provider server (300).

[0025] The student terminal (100), the lecturer terminal (200), and the service provider server (300) can communicate with each other through a communication network, for example, a mobile communication network, a local area network (LAN), a metropolitan area network (MAN), a wide area network (WAN), the World Wide Web (WWW), and a wireless communication network (WiFi).

[0026] The student terminal (100) and the lecturer terminal (200) are equipped with computing functions and may be implemented in any form as long as they are devices capable of communicating with the outside. For example, they may be implemented as smartphones, tablet PCs, desktops, laptops, PDAs, etc., but are not limited thereto.

[0027] Additionally, the student terminal (100) and the lecturer terminal (200) may be equipped with a shooting module for real-time video recording. The student terminal (100) and the lecturer terminal (200) may have an application installed to implement the functions described below. Such an application may be downloaded and installed from a remote lecture service provider server (300) or an app store server other than the one described above.

[0028] A student terminal (100) according to one embodiment receives a lecture video transmitted from an instructor terminal (200) through a service provider server (300) and displays it in a form that a student can view. In the interactive lecture content, the student terminal (100) can transmit information entered by a student to the instructor terminal (200) through the remote lecture service provider server (300). Additionally, the student terminal (100) captures a video of a student currently taking the lecture and transmits the captured information to the service provider server (300).

[0029] According to one embodiment, the lecturer terminal (200) captures a lecture video of the lecturer and transmits it to the student terminal (100) via the service provider server (300). In addition, it transmits lecture-related information entered by the lecturer and can receive information on the students' concentration levels checked by the service provider server (300).

[0030] A service providing server (300) according to one embodiment transmits a lecture video transmitted from an instructor terminal (200) to a student terminal (100), and analyzes a video related to a student's attitude to be taken from the student terminal (100) to determine whether the student is attending and to analyze the level of concentration. The checked level of concentration is transmitted to the student terminal (100) and / or the instructor terminal (200) so that it can be expressed in a visual form.

[0031] FIG. 2 is a block diagram illustrating the detailed configuration and functions of a service providing server according to an embodiment of the present invention.

[0032] Referring to FIG. 2, the service providing server (300) may be configured to include a lecture video transmission unit (310), an attendance verification unit (320), a concentration calculation unit (330), and an information transmission unit (340).

[0033] The lecture video transmission unit (310), attendance verification unit (320), concentration calculation unit (330), and information transmission unit (340) may be program modules or hardware capable of communicating with external devices. Such program modules or hardware may be included in the service providing server (300) or other devices capable of communicating therewith in the form of an operating system, application program modules, and other program modules, and may be physically stored on various known storage devices. Meanwhile, such program modules or hardware include, but are not limited to, routines, subroutines, programs, objects, components, data structures, etc., that perform specific tasks or execute specific abstract data types as described below according to the present invention.

[0034] A lecture video transmission unit (310) according to one embodiment receives a video recording related to a lecturer's lecture transmitted from a lecturer terminal (200) and transmits it to a student terminal (100). It may provide functions such as sharing the screen of the lecturer or student during the lecture process, real-time recording and recording functions, etc.

[0035] Additionally, a video of a student's face captured in real time by a student terminal (100) can be received and transmitted to an instructor terminal (200). Specifically, the student watches a lecture video displayed on the screen of the student terminal (100), and a shooting module mounted adjacent to the display screen of the student terminal (100) can capture the face of the student facing the screen and transmit it to a remote lecture service provider server (300). Additionally, a shooting module provided separately from the student terminal (100) where the lecture video is played can capture and transmit the frontal view of the student facing the student terminal (100).

[0036] FIG. 3 is a drawing showing an example of a real-time face capture video of students according to an embodiment of the present invention.

[0037] Each student enters their name when accessing the lecture, and for each name, a video captured by the student terminal (100) that entered the name can be displayed as shown in FIG. 3. For each student, the name and the video currently being captured in real time can be displayed together.

[0038] The video can also be transmitted to the lecturer terminal (200) via the service provider server (300).

[0039] An attendance verification unit (320) according to one embodiment performs the function of determining whether a student is present or absent.

[0040] As described above, when a student registers for or signs up for a video education / lecture service, they enter personal information (name, phone number, etc.), and when accessing a lecture, they enter their personal information (name, phone number, etc.) to access it, and for each student, it is displayed as shown in FIG. 3. In a screen where the names and real-time video recordings of multiple students are displayed together, the screen corresponding to each student is referred to as a section.

[0041] In other words, in each section of the screen, the student's name and a real-time captured face are displayed.

[0042] The attendance verification unit (320) detects whether a student's face is currently being captured in real time or at a predetermined interval in each section for each student currently connected to the video education. This can be performed using a publicly known object detection algorithm in the video.

[0043] According to one embodiment, when a student wants to listen to a lecture by a specific lecturer by accessing a remote lecture service provider server (300), the student accesses the remote lecture service provider server (300) by entering their identification information (e.g., ID or name, etc.) into a student terminal (100). The attendance verification unit (320) can check attendance by referring to the previously obtained attendance information of the corresponding lecture and comparing the identification information entered with the attendance information. At this time, the attendance verification unit (320) can process personal information for identification purposes, excluding personal information (e.g., name, etc.) that can be disclosed to a third party.

[0044] In addition, the attendance check unit (320) can detect when a student leaves their seat.

[0045] According to one embodiment, if a specific student's face image is not continuously verified for a first threshold time (e.g., 2 minutes), it is determined to be "continuous no seat available." In this case, a push message including a warning message may be sent to the student terminal (100) of the student who has left their seat. Additionally, information about the student for whom continuous no seat availability has been detected may also be sent to the lecturer terminal (200).

[0046] Meanwhile, if the cumulative time during which a specific student's face is not recognized exceeds the second threshold time (e.g., 8 minutes or 16 minutes), it is determined as “cumulative no seat.”

[0047] Meanwhile, according to one embodiment, a student may stop having their face photographed through a student terminal (100). That is, real-time student face photography may be selectively stopped by methods such as inputting a command to disable a shooting module built into the student terminal (100). In this case, the student's real-time course screen will be transmitted to the service server (300) with the screen blinded. In this case, the second threshold time may be set to be inversely proportional to the accumulated time of blinding. That is, as the time of blinding increases, the likelihood of determining the student as having "no accumulated slots" increases.

[0048] Additionally, the second threshold time may be set to be inversely proportional to the number of “no consecutive digits”.

[0049] Combining these, the second threshold time (Th2) can be expressed by the following mathematical formula, where k is a constant, TB is the cumulative time during which the video is transmitted with blind processing during the lecture, and C is the number of times the student is judged to have no consecutive seats.

[0050]

[0051] If it is determined that there are “no seats available,” the student may be marked as absent for the relevant class.

[0052] In addition, if the name accessed in the lecture is not a previously registered name, a notification regarding this can be sent to the student terminal (100) and the lecturer terminal (200).

[0053] The concentration calculation unit (330) receives a video related to the student's attitude toward taking classes from the student terminal (100), analyzes it, and performs the function of calculating the concentration level.

[0054] According to one embodiment, the concentration calculation unit (320) can calculate the student's concentration on the lecture by analyzing the student's face angle and eye shape based on the video transmitted from the student terminal (100).

[0055] Specifically, the concentration calculation unit (320) can recognize the angle of the student's face by performing a simulation of the face area in the image in real time and comparing it with the simulation result when looking straight ahead, and accordingly, can calculate the concentration.

[0056] This can be achieved by comparing the simulated prototype while the student is looking straight ahead with the simulated shape of the student's facial image acquired in real time. The concentration level based on facial angle analysis can be calculated to be inversely proportional to the difference value of the above comparison result.

[0057] According to one embodiment, the information transmission unit (340) stores the attendance / absence information and concentration level information of each student confirmed by the attendance confirmation unit (320), and may transmit the information to the student terminal (100) and / or the lecturer terminal (200).

[0058] FIG. 4 illustrates an example of transmitting information regarding each student's absence status and no attendance record status according to an embodiment of the present invention.

[0059] The foregoing description of the present invention is for illustrative purposes only, and those skilled in the art will understand that other specific forms can be easily modified without altering the technical spirit or essential features of the present invention. Therefore, the embodiments described above should be understood as illustrative in all respects and not restrictive. For example, each component described as a single unit may be implemented in a distributed manner, and components described as distributed may likewise be implemented in a combined form.

[0060] The scope of the present invention is defined by the claims set forth below, and all modifications or variations derived from the meaning and scope of the claims and equivalent concepts thereof should be interpreted as being included within the scope of the present invention.

Claims

1. As a method for a service server to monitor video education, A step of transmitting a lecture video received from an instructor terminal to a student terminal, and receiving a face image of each student captured in real-time from the student terminal and a student name received from the student terminal; A step of transmitting a video to the instructor terminal that includes multiple sections, each consisting of each student's name and each student's face image; A step of verifying attendance by comparing student identification information received from each student terminal with pre-established attendance register information; and A video education monitoring method comprising, in each section, a step of determining that there is no consecutive seat for the student if the time during which the student's face image is not recognized lasts longer than a first threshold time.

2. In Paragraph 1, A video education monitoring method comprising, in each section, a step of determining that there is no cumulative seat for the student if the cumulative time during which the student's face image is not recognized is greater than or equal to a second threshold time.

3. In Paragraph 2, A video education monitoring method in which the second threshold time is set to be inversely proportional to the number of times determined to be consecutive empty slots.

Images