Education management method and system based on cloud platform

Through the cloud-based educational management method, recording and analyzing user video viewing operations, extracting and marking video segment related content, and filling in interpreted subtitles, the problem of low learning efficiency caused by the large content span in online courses is solved, and more efficient learning is achieved Experience.

CN118942012AInactive Publication Date: 2024-11-12SHUORUI (NANTONG) INFORMATION TECH CO LTD
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
CN202411077664.8
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-08-07
Publication Date
2024-11-12
Estimated Expiration
Not applicable · inactive patent

AI Technical Summary

Technical Problem

In online course videos, the content related to the front and back is large, which causes students to need to repeatedly fast forward and playback operations, and they cannot see the matching interpretation content in a single video segment, resulting in low learning efficiency and delayed progress.

Method used

The educational management method based on cloud platform, by recording the user's video viewing operations, extracting video segment distribution, analyzing and marking the optimal video segment association content, extracting interpreted text using the video text database, and filling in the blank area in the video as subtitles.

Benefits of technology

It improves students' learning efficiency, and accurately meets students' needs for viewing related content through the universality and relevance score of multi-user operations, reducing the operational complexity in learning.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118942012A_ABST
    Figure CN118942012A_ABST
Patent Text Reader

Abstract

The invention discloses an education management method and system based on a cloud platform. In order to solve the problem that the span of front and back associated contents in a course video is relatively large, the method comprises the following steps: extracting multiple user operations, extracting user operation video segments according to multiple user common operations, and judging the association degree of the multiple user operation video segments; and finding out the user operation video segment with the highest association degree of the single user operation video segment, predicting similar contents in the user operation video segment, extracting corresponding explanation texts from the video text database according to the similar contents, and filling the explanation texts into the user operation video segments to complete processing of the associated user operation video segments. The learning requirements of the students are better met, and the requirements of the students for checking associated contents in the learning process are met.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention belongs to the field of teaching technology and relates to an education management method and system based on a cloud platform. Background Art

[0002] With the continuous development of educational informatization, online courses have become increasingly important. Many organizations are creating and offering large-scale online courses, and many companies have begun to cooperate with universities or individual organizations to provide rich and diverse courses.

[0003] Due to the limitations of teachers' teaching habits, the span of related content in some course videos is relatively large. Students watching teaching videos may need to fast forward and replay repeatedly. They cannot see the explanation content that matches the current video content in a single video segment and need to look through the content in other video segments, resulting in low learning efficiency and delayed learning progress. Summary of the invention

[0004] In order to solve the problems existing in the background technology, the present invention proposes an education management method and system based on a cloud platform.

[0005] In order to achieve the above object, the technical solution adopted by the present invention is as follows:

[0006] The user retrieves a video from the video text database;

[0007] Record the user's operations when watching the video and pre-process the user's operations;

[0008] Extract the video time points of the played video during multi-user operation and extract the distribution of user operation video segments;

[0009] Analyze the user operation video segments and extract the optimal user operation video segment associated with any user operation video segment;

[0010] Marking similar contents in a certain user operation video segment and the optimal user operation video segment associated with the user operation video segment, and extracting corresponding explanation texts from a video text database based on the similar contents;

[0011] Retrieve the user operation video segment, determine the common blank area of ​​multiple frames in a single user operation video segment, and retrieve the space position required for the explanation text to fill it;

[0012] The extracted interpretation text is used as subtitles to fill the retrieved blank positions.

[0013] Furthermore, the user's operations when watching the video are recorded, and the user operations include fast-forward operations and playback operations.

[0014] Furthermore, the specific method of preprocessing the user operation is as follows:

[0015] Grouping a single user operation based on a video time point of playing a video by the user operation, setting a first time range, and merging and recording the user operations within the first time range;

[0016] Filter invalid user operations. When the time interval between two adjacent user operations is within the first time range, set a second time value, and do not record user operations if the difference between the video playback time point when the user operation is completed and the video playback time point when the user operation is performed is less than or equal to the second time value.

[0017] The video time point when the video is played during the user operation and the video playback time point when the user operation is completed are retained.

[0018] Furthermore, the video time points of the played videos during multi-user operation are extracted, and the distribution of the user operation video segments is extracted as follows:

[0019] Extracting operation records of any user in a certain video, sorting the video time points of the playing video when the user operates according to the physical time sequence, and generating a first time sequence;

[0020] Sort the operation records of other users in the video according to physical time to generate other time series;

[0021] Compare the other time series with the first time series, traverse the video time points of the user's operation to play the video in the other time series, and compare them with the video time points of the user's operation to play the video in the first time series, if the time difference between the video time point Tn of the user's operation to play the video in the other time series and the video time point Tm of the user's operation to play the video in the first time series is less than the third time value, classify the video operation time Tn and the video operation time Tm as the same operation;

[0022] If the proportion of the same operation in the same video is greater than a preset proportion, the video segment within a fourth time value before and after the video time point Tm of the operation video is marked as a user operation video segment.

[0023] Furthermore, the user operation video segments are analyzed, and the method of extracting the optimal user operation video segment associated with any user operation video segment is as follows:

[0024] Set any one user operation video segment, take other user operation video segments as reference video segments, and find the user operation video segment with the highest correlation with the single user operation video segment. The specific formula is:

[0025]

[0026] Where k is the number of video segments, pi is the probability of associating the i-th user operation video segment with the user operation video segment, where Calculate p i , and associate the user operation video segment corresponding to the maximum value with the user operation video segment to obtain the optimal user operation video segment associated with the user operation video segment.

[0027] Furthermore, a method for marking similar contents in a certain user operation video segment and an optimal user operation video segment associated with the user operation video segment is as follows:

[0028] Extract the content of a certain user operation video segment and the optimal user operation video segment associated with the user operation video segment, combine the above content with the topics in the above two user operation video segments, and predict similar content. The specific formula is:

[0029]

[0030] Wherein w3 is the similar content to be predicted, w1 and w2 are the contents respectively contained in the user operation video segment and the optimal user operation video segment associated with the user operation video segment, and subject represents the theme. By referring to the themes of the above two user operation video segments, the similar content w3 is predicted, the specific meaning of the similar content w3 is determined, and the similar content w3 is marked in the user operation video segment.

[0031] Furthermore, the method of determining whether multiple frames of images in a single user operation video segment have common blank areas and retrieving the space position required for filling the explanatory text is as follows:

[0032] First, extract the first frame of the user operation video segment, retrieve the blank area therein, extract it using the image gradient value, set the image gradient preset value, mark the area where the image gradient threshold is less than the image gradient preset value, and retrieve the first blank area;

[0033] Determine changes in the first blank area of ​​the multi-frame images of the user operation video segment, determine whether the first blank area is blocked, and adjust the first blank area according to the images in the multi-frame images that block the first blank area to obtain a second blank area;

[0034] When the area of ​​the second blank region is greater than or equal to the area required for the explanatory text, the second blank region is used to fill the required spatial position for the explanatory text; otherwise, the required spatial position for the explanatory text is re-determined.

[0035] On the other hand, the present invention also provides an education management system based on a cloud platform, which is used to execute the above-mentioned education management method based on a cloud platform, and includes the following modules:

[0036] Data acquisition module, which records the user's operations when watching videos;

[0037] Storage server, used to store user operation record data and video text database;

[0038] The data cleaning module is responsible for cleaning the acquired user operation record data;

[0039] The calculation module is responsible for merging user operations, calculating the correlation between user operation video segments, and extracting similar content.

[0040] Compared with the prior art, the present invention has the following beneficial effects:

[0041] The present invention records the operations of multiple users on the same video, and processes the same video segment only after multiple users have operated on it. The processing of the video is universal and better meets the learning needs of students. At the same time, the relevance of related video segments is scored and the content in the video segment with the highest relevance is compared. The calculation results are accurate and can meet the needs of students to view related content during the learning process. BRIEF DESCRIPTION OF THE DRAWINGS

[0042] Figure 1 It is a flow chart of the operation of the method of the present invention;

[0043] Figure 2 It is a schematic diagram of the system structure of the present invention. DETAILED DESCRIPTION

[0044] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0045] like Figure 1 As shown, in order to achieve the above purpose, the technical solution of a cloud-based education management method adopted by the present invention is as follows:

[0046] The user retrieves a video from the video text database. The video text database includes teaching videos and teaching knowledge points involved in the teaching videos. The teaching knowledge points are recorded in a text file in the form of an explanation text.

[0047] Record the user's operations when watching the video and pre-process the user operations.

[0048] The video time point of the video played during multi-user operation is extracted to extract the distribution of the user operation video segments. The video time point of the video played during the user operation is the video time point of the video played when the user operation is initiated.

[0049] The user operation video segments are analyzed to extract the optimal user operation video segment associated with any user operation video segment.

[0050] Similar contents in a certain user operation video segment and the optimal user operation video segment associated with the user operation video segment are marked, and corresponding explanation texts are extracted from a video text database based on the similar contents.

[0051] Retrieve the user operation video segment, determine whether multiple frames of images in a single user operation video segment have common blank areas, and retrieve the space position required for the explanatory text to fill it.

[0052] The extracted interpretation text is used as subtitles to fill the retrieved blank positions.

[0053] In the above process, the user's operations when watching the video are recorded, and the user operations include fast-forward operations and playback operations.

[0054] After extracting the user operations, pre-process the user operations to complete data cleaning and reduce the system's useless operations on users. The specific methods are as follows:

[0055] A single user operation is grouped based on the video time point of the video played by the user operation, a first time range is set, and the user operations within the first time range are merged and recorded.

[0056] When a user fast-forwards or rewinds multiple times in a row, or rewinds after fast-forwarding beyond the user's expectation, or fast-forwards after rewinding beyond the user's expectation, multiple user operation records will be generated. In fact, only one operation record is needed to complete the record of the user's continuous operations.

[0057] Filter invalid user operations. When the time interval between two adjacent user operations is within the first time range, set the second time value, and do not record user operations if the difference between the video playback time point when the user operation is completed and the video playback time point when the user operation is played is less than or equal to the second time value. After the user makes an erroneous operation, for example, the user rewinds the video to the video playback time 5 minutes ago, and corrects the video playback time within the first time range, the video time that the user needs to watch has not changed, and the difference between the video playback time point when the user operation is completed and the video playback time point when the user operation is played is less than or equal to the second time value, so it is not recorded.

[0058] The time point of the video played when the user operates and the time point of the video played when the user operation is completed are retained. In this way, a complete and effective operation of the user can be recorded.

[0059] After obtaining the user's operation on a certain video, the video time point of the video played during multi-user operation is extracted, and the distribution of the user operation video segment is extracted as follows:

[0060] First, any user's operation on a single video is used as benchmark data, and the operation record of any user in a certain video is extracted. The video time points of the playing video when the user operates are sorted according to the physical time sequence to generate a first time series.

[0061] The operation records of other users in the video are sorted according to physical time to generate other time series as comparison data.

[0062] Compare other time series with the first time series, traverse the video time points of the user operation to play the video in other time series, and compare them with the video time points of the user operation to play the video in the first time series. If the time difference between the video time point Tn of the user operation to play the video in other time series and the video time point Tm of the user operation to play the video in the first time series is less than the third time value, the video operation time Tn and the video operation time Tm are classified as the same operation. Compare the single user operation data with the control data of other user operations, and add a certain error range. The operations within a certain time range can be judged as the same operation, and the operations of multiple users are normalized.

[0063] If the proportion of the same operation in the same video is greater than the preset proportion, the video segment within the fourth time value before and after the video time point Tm of the video played by the operation is marked as the user operation video segment. The operations shared by multiple users are extracted, and the extracted video segment needs to include the content that the current user operation needs to watch, providing a video reference for subsequent annotation.

[0064] After extracting the video segments that users need to operate, the user operation video segments are analyzed, and the method of extracting the optimal user operation video segment associated with any user operation video segment is as follows:

[0065] Set any one user operation video segment, take other user operation video segments as reference video segments, and find the user operation video segment with the highest correlation with the single user operation video segment. The specific formula is:

[0066]

[0067] Where k is the number of video segments, p iis the probability of associating the i-th user operation video segment with the user operation video segment, where Calculate p i The maximum value of , the user operation video segment corresponding to the maximum value is associated with the user operation video segment, and the optimal user operation video segment associated with the user operation video segment is obtained. The optimal user operation video segment corresponding to a single user operation video segment may also be the optimal user operation video segment of other user operation video segments, and only the optimal user operation video segment of the current user operation video segment is extracted.

[0068] After the optimal user operation video segment associated with the current user operation video segment is determined, similar contents in a certain user operation video segment and the optimal user operation video segment associated with the user operation video segment are marked. The specific method is as follows:

[0069] Extract the content of a certain user operation video segment and the optimal user operation video segment associated with the user operation video segment, combine the above content with the topics in the above two user operation video segments, and predict similar content. The specific formula is:

[0070]

[0071] Among them, w3 is the similar content to be predicted, w1 and w2 are the contents contained in the user operation video segment and the optimal user operation video segment associated with the user operation video segment, and subject represents the theme. By referring to the themes of the above two user operation video segments, similar content w3 is predicted, the specific meaning of similar content w3 is determined, and similar content w3 is marked in the user operation video segment. Similar content w3 combines the content in the current user operation video segment and the optimal user operation video segment associated with the user operation video segment, and has a high accuracy rate in judging similar content, and can accurately express the similar content in the current user operation video segment and the optimal user operation video segment associated with the user operation video segment.

[0072] The corresponding explanation text is extracted from the video text database based on similar content.

[0073] Determine the shared blank area among multiple frames of the current user operation video segment. The specific method is as follows:

[0074] First, extract the first frame of the user operation video segment, retrieve the blank area therein, extract it using the image gradient value, set the image gradient preset value, mark the area where the image gradient threshold is less than the image gradient preset value, and retrieve the first blank area;

[0075] Determine changes in the first blank area of ​​the multi-frame images of the user operation video segment, determine whether the first blank area is blocked, and adjust the first blank area according to the images in the multi-frame images that block the first blank area to obtain a second blank area;

[0076] When the area of ​​the second blank region is greater than or equal to the area required for the explanatory text, the second blank region is used to fill the required spatial position for the explanatory text; otherwise, the required spatial position for the explanatory text is re-determined.

[0077] like Figure 2 As shown, the present invention also provides an education management system based on a cloud platform, which is used to execute the above-mentioned education management method based on a cloud platform, and includes the following modules:

[0078] Data acquisition module, which records the user's operations when watching videos;

[0079] Storage server, used to store video text database and user operation record data;

[0080] The data cleaning module is responsible for cleaning the acquired user operation record data;

[0081] The calculation module is responsible for merging user operations, calculating the correlation between user operation video segments, and extracting similar content.

[0082] The above method and system can jointly record the operations of multiple users on the same video, better meet the learning needs of students, and solve the needs of students to view related content during the learning process.

[0083] Although the present invention has been described in detail with reference to the aforementioned embodiments, it is still possible for those skilled in the art to modify the technical solutions described in the aforementioned embodiments, or to make equivalent substitutions for some of the technical features therein. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present invention should be included in the protection scope of the present invention.

Claims

1. An education management method based on a cloud platform, characterized in that: Included are: The user retrieves a video from the video text database; Record the user's operations when watching the video and pre-process the user's operations; Extract the video time points of the played video during multi-user operation and extract the distribution of user operation video segments; Analyze the user operation video segments and extract the optimal user operation video segment associated with any user operation video segment; Marking similar contents in the user operation video segment and the optimal user operation video segment associated with the user operation video segment, and extracting corresponding explanation texts from the video text database based on the similar contents; Retrieve the user operation video segment, determine the common blank area of ​​multiple frames in a single user operation video segment, and retrieve the space position required for the explanation text to fill it; The extracted interpretation text is used as subtitles to fill the retrieved blank positions.

2. The cloud-based education management method according to claim 1, characterized in that , record the user's operations when watching the video, and the user operations include fast forward operation and playback operation.

3. The cloud-based education management method according to claim 1 is characterized in that ,The specific way to preprocess user operations is: Grouping a single user operation based on a video time point of playing a video by the user operation, setting a first time range, and merging and recording the user operations within the first time range; Filter invalid user operations. When the time interval between two adjacent user operations is within the first time range, set a second time value, and do not record user operations if the difference between the video playback time point when the user operation is completed and the video playback time point when the user operation is performed is less than or equal to the second time value. The video time point when the video is played during the user operation and the video playback time point when the user operation is completed are retained.

4. The cloud platform-based education management method according to claim 3 is characterized in that ,The video time points of the playing videos during multi-user operation are extracted, and the distribution of the user ,operation video segments is extracted as follows: Extracting operation records of any user in a certain video, sorting the video time points of the playing video when the user operates according to the physical time sequence, and generating a first time sequence; Sort the operation records of other users in the video according to physical time to generate other time series; Compare the other time series with the first time series, traverse the video time points of the user's operation to play the video in the other time series, and compare them with the video time points of the user's operation to play the video in the first time series, if the time difference between the video time point Tn of the user's operation to play the video in the other time series and the video time point Tm of the user's operation to play the video in the first time series is less than the third time value, classify the video operation time Tn and the video operation time Tm as the same operation; If the proportion of the same operation in the same video is greater than a preset proportion, the video segment within a fourth time value before and after the video time point Tm of the operation video is marked as a user operation video segment.

5. The cloud platform-based education management method according to claim 4 is characterized in that ,The method of analyzing the user operation video segments and extracting the ,optimal user operation video segment associated with any user operation video segment is as follows: Set any one user operation video segment, take other user operation video segments as reference video segments, and find the user operation video segment with the highest correlation with the single user operation video segment. The specific formula is: Where k is the number of video segments, p i is the probability of associating the i-th user operation video segment with the user operation video segment, where Calculate p i , and associate the user operation video segment corresponding to the maximum value with the user operation video segment to obtain the optimal user operation video segment associated with the user operation video segment.

6. The cloud platform-based education management method according to claim 1, characterized in that ,The method for marking similar contents in a user operation video segment and the ,optimal user operation video segment associated with the user operation video segment is as follows: Extract the content of a certain user operation video segment and the optimal user operation video segment associated with the user operation video segment, combine the above content with the topics in the above two user operation video segments, and predict similar content. The specific formula is: Wherein w3 is the similar content to be predicted, w1 and w2 are the contents respectively contained in the user operation video segment and the optimal user operation video segment associated with the user operation video segment, and subject represents the theme. By referring to the themes of the above two user operation video segments, the similar content w3 is predicted, the specific meaning of the similar content w3 is determined, and the similar content w3 is marked in the user operation video segment.

7. The cloud platform-based education management method according to claim 1, characterized in that ,The method of judging the common blank areas in multiple frames of a single user ,operation video segment and retrieving the required spatial position for the ,explanatory text filling is: First, extract the first frame of the user operation video segment, retrieve the blank area therein, extract it using the image gradient value, set the image gradient preset value, mark the area where the image gradient threshold is less than the image gradient preset value, and retrieve the first blank area; Determine changes in the first blank area of ​​the multi-frame images of the user operation video segment, determine whether the first blank area is blocked, and adjust the first blank area according to the images in the multi-frame images that block the first blank area to obtain a second blank area; When the area of ​​the second blank region is greater than or equal to the area required for the explanatory text, the second blank region is used to fill the required spatial position for the explanatory text; otherwise, the required spatial position for the explanatory text is re-determined.

8. An education management system based on a cloud platform, used to execute an education management method based on a cloud platform according to claims 1 to 7, characterized in that: Includes the following modules: Data acquisition module, which records the user's operations when watching videos; Storage server, used to store user operation record data and video text database; The data cleaning module is responsible for cleaning the acquired user operation record data; The calculation module is responsible for merging user operations, calculating the correlation between user operation video segments, and extracting similar content.

Citation Information

Patent Citations

  • Method for dynamically adding subtitles based on video content

    CN101917557A

  • Teaching video processing method and device and electronic equipment

    CN113259763A

  • Online and offline linkage learning system based on big data cloud platform

    CN116405621A