Digital network course playback abnormality monitoring method and device

Abstract

The present invention provides a method and device for monitoring abnormal playback of online courses based on digitization. The method comprises the following steps: retrieving courseware data and updating it to a courseware area in a preset interface, obtaining position data of an update point corresponding to a target person in course acquisition data, and updating a character model corresponding to the target person to the preset interface based on the position data; analyzing the position of a focus pixel value corresponding to the target person in the course acquisition data to determine an explanation paragraph, and highlighting and displaying the explanation paragraph in the courseware data based on a preset mark; responding to frame selection display information of a teacher end, analyzing the movement trajectory of a focus pixel value corresponding to the target person in the course acquisition data to determine an explanation segment in the courseware data, and highlighting and displaying the explanation segment in the courseware data based on a preset mark; obtaining an abnormal playback rate based on a network connection rate of each student end and a preset regular rate, optimizing the update point based on the abnormal playback rate and a point optimization strategy, and generating an optimized display interface to send to the student end.

Description

Technical Field

[0001] The invention relates to data processing technology, and in particular to a method and device for monitoring abnormality of playing of network courses based on digitization. Background Art

[0002] An online course is the sum of the teaching content and teaching activities of a certain subject presented through the Internet. It is a new form of course presentation under the conditions of the information age. To realize the normal teaching functions of online courses, an online teaching support environment is required. The online teaching support environment specifically refers to the software tools and teaching resources that support online teaching, as well as the teaching activities implemented on the online teaching platform.

[0003] At present, when teaching through the Internet, filming equipment is usually used to record course explanation videos, and then the recorded video courses are sent to the network platform for people to watch. However, the lecturer will move and give instructions according to the teaching content. As a result, abnormal teaching content or unclear lecturer images may occur in the recorded video courses, which affects people's viewing and learning.

[0004] Therefore, how to play online courses normally and improve the clarity of online course images has become an urgent problem to be solved. Summary of the invention

[0005] The present invention provides a method and device for monitoring abnormality of playing of online courses based on digitization, which can play online courses normally and improve the clarity of online course pictures.

[0006] A first aspect of an embodiment of the present invention provides a method for monitoring abnormalities in playing a digital online course, comprising:

[0007] Retrieving courseware data to update to the courseware area in the preset interface, and obtaining the position data of the target person corresponding to the update point in the course collection data, and updating the character model corresponding to the target person to the preset interface based on the position data;

[0008] In response to the paragraph display information of the teacher end, the position of the focus pixel value corresponding to the target person in the course collection data is analyzed to determine the explanation paragraph, and the explanation paragraph in the courseware data is highlighted based on the preset mark;

[0009] In response to the box selection display information of the teacher end, the moving trajectory of the focus pixel value corresponding to the target person in the course collection data is analyzed, the explanation segment in the courseware data is determined, and the explanation segment in the courseware data is highlighted based on the preset mark;

[0010] According to the network connection rate of each student terminal and the preset normal rate, the abnormal playback rate is obtained, the update point is optimized according to the abnormal playback rate and the point optimization strategy, and an optimized display interface is generated and sent to the corresponding student terminal.

[0011] Optionally, in a possible implementation of the first aspect, the retrieving courseware data to update the courseware area in the preset interface, and obtaining the position data of the target person corresponding to the update point in the course collection data, and updating the character model corresponding to the target person to the preset interface based on the position data, includes:

[0012] Retrieve courseware data and update it to the courseware area in the preset interface, and receive course collection data collected by the collection device;

[0013] Based on OpenCV, the update point corresponding to the target person in the course collection data is obtained, and the center point of the course collection data is obtained as the collection center point, a coordinate system is constructed based on the collection center point, and the coordinates corresponding to the update point are determined as position data;

[0014] The center point of the preset interface is obtained as the playback center point, and a coordinate system is constructed based on the playback center point, and the character model corresponding to the target character is updated to the preset interface based on the position data.

[0015] Optionally, in a possible implementation of the first aspect, the responding to the paragraph display information of the teacher end, analyzing the position of the focus pixel value corresponding to the target person in the course collection data, determining the explanation paragraph, and highlighting the explanation paragraph in the courseware data based on a preset mark, includes:

[0016] In response to the paragraph display information of the teacher end, the trajectory coordinates of the focus pixel values ​​corresponding to the target person in the course collection data in the teaching area are counted to obtain a trajectory coordinate set;

[0017] Obtaining the dwell time of each track coordinate in the track coordinate set, and when it is determined that the dwell time is greater than or equal to a preset time, using the corresponding track coordinate as a positioning coordinate;

[0018] The font coordinates in the teaching area are determined according to the font pixel values, and the positioning distance is obtained by calculation based on the positioning coordinates and the font coordinates. The font paragraph corresponding to the font coordinates with the shortest positioning distance is determined as the explanation paragraph, and the explanation paragraph in the courseware data is highlighted according to the preset mark.

[0019] Optionally, in a possible implementation of the first aspect, the method further includes:

[0020] When it is determined that the stay durations are all less than the preset duration, obtaining repeated trajectory coordinates in the trajectory coordinate set as positioning coordinates, and counting adjacent positioning coordinates to obtain a positioning area;

[0021] Obtaining the coordinates of the center point corresponding to the positioning area as the coordinates of the midpoint of the area, and determining the font coordinates in the teaching area according to the font pixel value;

[0022] A calculation is performed based on the midpoint coordinates of the region and the font coordinates to obtain a judgment distance, and the font paragraph corresponding to the font coordinates of the shortest judgment distance is determined as the explanation paragraph. The explanation paragraph in the courseware data is highlighted according to a preset mark.

[0023] Optionally, in a possible implementation of the first aspect, in response to the frame selection display information of the teacher end, analyzing the movement trajectory of the focus pixel value corresponding to the target person in the course collection data, determining the explanation segment in the courseware data, and highlighting the explanation segment in the courseware data based on a preset mark, including:

[0024] In response to the box selection display information of the teacher end, a moving trajectory of the focus pixel value corresponding to the target person in the course collection data in the teaching area is obtained;

[0025] Deleting and updating the movement trajectory according to the frame selection area strategy to obtain the frame selection area;

[0026] Based on the framed area, the font paragraphs in the teaching area are intercepted and processed to obtain the explanation segments corresponding to the courseware data, and based on the preset marks, the explanation segments in the courseware data are highlighted and displayed.

[0027] Optionally, in a possible implementation manner of the first aspect, the deleting and updating the movement track according to the frame selection area strategy to obtain the frame selection area includes:

[0028] Extracting repeated coordinates in the movement trajectory as repeated coordinates, determining the first repeated coordinate in the movement trajectory as the first intercepted coordinate, and determining the second repeated coordinate in the movement trajectory as the second intercepted coordinate;

[0029] Determine the coordinates of the movement trajectory located in front of the first interception coordinates as the initial interception coordinates, and determine the coordinates of the movement trajectory located in the rear of the second interception coordinates as the final interception coordinates;

[0030] The movement track is deleted and updated according to the initial interception coordinates and the final interception coordinates to obtain a framed area.

[0031] Optionally, in a possible implementation of the first aspect, the intercepting and processing the font paragraphs in the teaching area based on the framed area to obtain the explanation segment corresponding to the courseware data includes:

[0032] Determine the font paragraph in the framed area as a paragraph to be processed, and construct a positioning underline below the paragraph to be processed;

[0033] The intersection of the framed area and the positioning underline is used as the intersection to be processed, and a positioning vertical line perpendicular to the positioning underline is constructed based on the intersection to be processed;

[0034] When it is determined that the positioning vertical line has a font intersecting with the corresponding paragraph to be processed, the corresponding font is used as the font to be determined, and the number of pixel points of the font to be determined corresponding to the font pixel value within the frame selection area is obtained as the interception number;

[0035] Determine the number of pixel points of the font pixel value corresponding to the font to be determined as the total number, and obtain the interception ratio according to the ratio of the intercepted number to the total number;

[0036] When it is determined that the interception ratio is greater than the preset ratio, the corresponding font to be determined is used as the interception font;

[0037] When it is determined that the positioning vertical line has no font intersecting with it in the corresponding paragraph to be processed, two fonts closest to the positioning vertical line in the corresponding paragraph to be processed are used as fonts to be selected, and the font to be selected located in the frame selection area is determined as the intercepted font;

[0038] Based on the intercepted font, the corresponding font paragraph is intercepted to obtain the explanation segment within the framed area.

[0039] Optionally, in a possible implementation of the first aspect, obtaining a playback abnormality rate according to a network connection rate of each student terminal and a preset regular rate, optimizing the update point according to the playback abnormality rate and a point optimization strategy, and generating an optimized display interface to send to the corresponding student terminal include:

[0040] Obtaining the network connection rate of each student terminal, and when determining that the network connection rate is less than a preset normal rate, obtaining the abnormal playback rate according to the difference between the preset normal rate and the network connection rate;

[0041] Based on the ratio of the abnormal playback rate to the preset point rate, obtaining the point adjustment quantity;

[0042] Obtaining a preset priority corresponding to each of the update points, and sorting the update points in ascending order based on the preset priority to obtain an update sequence;

[0043] Selecting an update point in the update sequence as a pause point according to the point adjustment quantity, and deleting and updating the update sequence based on the pause point to obtain a real-time sequence;

[0044] The position data of the updated points in the real-time sequence corresponding to the target person in the course collection data are obtained, the character model corresponding to the target person is updated to a preset interface based on the position data, and an optimized display interface is generated and sent to the corresponding student terminal.

[0045] Optionally, in a possible implementation manner of the first aspect, obtaining the point adjustment quantity based on the ratio of the abnormal playback rate to the preset point rate includes:

[0046]

[0047] Among them, n adj is the point adjustment quantity, s con is the preset normal rate, s rea is the network connection rate, y pre is the preset point rate, n pre The number of preset points.

[0048] A second aspect of the embodiments of the present invention provides a digital network course playback abnormality monitoring device, comprising:

[0049] A retrieval module is used to retrieve courseware data and update it to the courseware area in the preset interface, and obtain the position data of the target person corresponding to the update point in the course collection data, and update the character model corresponding to the target person to the preset interface based on the position data;

[0050] An analysis module, which is used to respond to the paragraph display information of the teacher end, analyze the position of the focus pixel value corresponding to the target person in the course collection data, determine the explanation paragraph, and highlight the explanation paragraph in the courseware data based on the preset mark;

[0051] A determination module, which is used to respond to the box selection display information of the teacher end, analyze the movement trajectory of the focus pixel value corresponding to the target person in the course collection data, determine the explanation segment in the courseware data, and highlight the explanation segment in the courseware data based on the preset mark;

[0052] A generation module is used to obtain the abnormal playback rate according to the network connection rate of each student terminal and the preset normal rate, optimize the update point according to the abnormal playback rate and the point optimization strategy, and generate an optimized display interface to send to the corresponding student terminal.

[0053] According to a third aspect of an embodiment of the present invention, there is provided an electronic device, comprising: a memory, a processor and a computer program, wherein the computer program is stored in the memory, and the processor runs the computer program to execute the first aspect of the present invention and various methods that may be involved in the first aspect.

[0054] According to a fourth aspect of an embodiment of the present invention, a storage medium is provided, in which a computer program is stored. When the computer program is executed by a processor, it is used to implement the first aspect of the present invention and various methods that may be involved in the first aspect.

[0055] The beneficial effects of the present invention are as follows:

[0056] 1. The present invention can improve the clarity of the online course screen and enhance the playback quality of the online course. At the same time, the present invention can also automatically determine the content indicated by the instructor and highlight it for students to watch the online course. Among them, the present invention can directly update the courseware data and the corresponding character model in the corresponding preset interface, so that the courseware content and the character screen in the displayed interface are clearer, which is convenient for students to watch and learn. The present invention can also analyze the position of the focus pixel value corresponding to the target character according to the paragraph display information or frame selection display information of the teacher end, so as to obtain the data content that needs to be highlighted and marked for display, so that students can intuitively and clearly view the corresponding key content. Finally, the present invention can optimize the interface of the abnormal situation of each student end, so that the interface sent to each student end can be played and watched normally, and the course playback quality is improved for students to watch and learn.

[0057] 2. The present invention can perform customized analysis based on the paragraph display information or frame selection display information of the teacher end, so as to determine the corresponding explanation paragraph or explanation segment, and highlight it to facilitate people's viewing and learning. Among them, when responding to the paragraph display information of the teacher end, the corresponding explanation paragraph can be determined according to the dwell time corresponding to the trajectory coordinates of the corresponding focus pixel value, so as to highlight it for people's intuitive viewing. When responding to the frame selection display information of the teacher end, the repeated coordinates in the moving trajectory can be determined, so as to delete and update the moving coordinates, eliminate the misleading of the redundant trajectory in determining the explanation segment, obtain the corresponding frame selection area, and then determine the corresponding explanation segment, and highlight it for people's viewing and learning.

[0058] 3. The present invention can optimize the update points that change in real time according to abnormal situations, reduce the changes in the update points, and prevent the screen from being confused due to the constant changes in the update points, thereby affecting students' viewing of the course. Among them, the present invention can judge the playback quality of the online course at each student end according to the network connection rate of each student end, thereby optimizing and updating the preset interface according to the actual network connection rate of each student end, obtaining an optimized display interface, improving the course playback quality at the student end, and facilitating personnel's learning and viewing. BRIEF DESCRIPTION OF THE DRAWINGS

[0059] Figure 1 A flowchart of a method for monitoring abnormal playback of digitalized online courses provided by the present invention;

[0060] Figure 2 A schematic diagram of a frame selection area provided by the present invention;

[0061] Figure 3 A schematic diagram of a font and a positioning vertical line intersecting provided by the present invention;

[0062] Figure 4 A schematic diagram of a font without intersection of a font and a positioning vertical line provided by the present invention;

[0063] Figure 5 The present invention provides a schematic structural diagram of a digital network course playback abnormality monitoring device. DETAILED DESCRIPTION

[0064] The technical solution of the present invention is described in detail with specific embodiments below. The following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be described in detail in some embodiments.

[0065] like Figure 1 As shown, the present invention provides a method for monitoring abnormal playback of a digitalized online course, comprising:

[0066] S1, retrieve courseware data and update it to the courseware area in the preset interface, and obtain the position data of the target person corresponding to the update point in the course collection data, and update the character model corresponding to the target person to the preset interface based on the position data.

[0067] It should be noted that, in existing practical applications, when the teaching process is recorded in video, the courseware content or the lecturer's image may be exposed. When the courseware image content is adjusted, the lecturer's image may be unclear. When the lecturer is adjusted, the courseware may be unclear. In order to solve the above technical problems, the present invention can directly update the courseware data in the courseware area of ​​the preset interface, so that the courseware content is clearer, and at the same time, the corresponding actions of the lecturer in the real-time recorded teaching video can be obtained. According to the actions of the person, the pre-set corresponding character model is updated at the corresponding position in the preset interface, so that the courseware data and the character image in the obtained video interface are clear at the same time.

[0068] It can be understood that the courseware data is the lecture content of the lecturer, such as the lecture content in the PPT, the preset interface is a pre-set interface, which is an interface with the same specifications and size as the video interface of the actual course collection data, and includes a courseware area. The courseware area is the area in the preset interface that displays the courseware content. The course collection data is a recorded lecture video of the teaching content and the instructor. The target person is the lecturer in the recorded video. The update point is a pre-set position update point, which is used to obtain the point for updating the action of the character model, for example, the point can be set at the hand position, the point can be set at the head position, etc. The position data is the corresponding coordinate position information, and the character model is a virtual model of the corresponding target person, which can be pre-set.

[0069] Through the above implementation, the present invention can update the courseware data and the corresponding character model in the corresponding preset interface, so that the courseware content and character images in the subsequent displayed interface are clearer, which is convenient for students to watch and learn.

[0070] In some embodiments, the specific implementation of step S1 (the process of retrieving courseware data and updating it to the courseware area in the preset interface, obtaining the position data of the target person corresponding to the update point in the course collection data, and updating the character model corresponding to the target person to the preset interface based on the position data) includes:

[0071] S11, retrieve courseware data and update it to the courseware area in the preset interface, and receive course collection data collected by the collection device.

[0072] It can be understood that the stored courseware data is retrieved and updated and displayed in the courseware area of ​​the preset interface. For example, the teaching PPT is updated in the courseware area, and at the same time, the course collection data collected by the collection device is received to facilitate the analysis of the course collection data, thereby updating the character model of the preset interface.

[0073] Among them, the collection device is a device for collecting the teaching process, which can be a camera.

[0074] Through the above implementation, the present invention can update the courseware data in the courseware area to facilitate viewing by personnel, and at the same time can obtain course collection data for subsequent analysis, thereby updating the preset interface.

[0075] S12, based on OpenCV, obtain the update point corresponding to the target person in the course collection data, and obtain the center point of the course collection data as the collection center point, build a coordinate system based on the collection center point, and determine the coordinates corresponding to the update point as position data.

[0076] It can be understood that the update points corresponding to the target person in the real-time recorded course collection data and the center point of the course collection data are obtained through OpenCV. In order to facilitate the acquisition of the target person's movements and update the character model according to the actual character movements, the center point of the course collection data can be used as the collection center point to obtain the coordinates corresponding to the update points, and the corresponding position coordinates are used as position data to facilitate the update and display of the character model.

[0077] Among them, the collection center point is the center point of the course collection data, and the position data is the coordinate data corresponding to the update point. For example, the coordinates of the update point at the hand are (5,1), and the coordinates of the update point at the head position are (6,4), etc.

[0078] S13, obtaining the center point of the preset interface as the playback center point, constructing a coordinate system based on the playback center point, and updating the character model corresponding to the target character to the preset interface based on the position data.

[0079] It can be understood that the preset interface can be set according to the screen specifications of the course collection data, so that the preset interface corresponds to the video screen of the course collection data. Therefore, the position in the preset interface corresponds to the position in the course collection data one-to-one. Therefore, the position coordinates after the coordinate system is constructed in the course collection data and the position coordinates after the coordinate system is established in the preset interface will also correspond one-to-one.

[0080] The playback center point is the center point of the preset interface.

[0081] It is not difficult to understand that, according to the position data of the corresponding update points of the target person in the actual course collection data, the points of the character model corresponding to the target person can be updated at the corresponding coordinate positions in the preset interface according to the corresponding position data, thereby realizing the update of the character model in the preset interface.

[0082] For example: when the coordinates of the updated point on the right hand of the target person in the course collection data are (5,1), the coordinates of the updated point on the left hand are (8,-1), the coordinates of the updated point on the head position are (6,4), etc., then the point on the right hand of the corresponding character model can be updated to the coordinate (5,1) in the preset interface, the point on the left hand of the character model can be updated to the coordinate (8,-1) in the preset interface, the point on the head position of the character model can be updated to the coordinate (6,4) in the preset interface, etc., to achieve the update of the character model in the preset interface.

[0083] It is worth mentioning that when the courseware data and character model are updated to the preset interface and subsequently transmitted to the corresponding device, the finally generated optimized display interface can be proportionally adjusted according to the size of the device interface so that the display screen is compatible with the device. This is the existing technology and will not be elaborated here.

[0084] S2, responding to the paragraph display information of the teacher side, analyzing the position of the focus pixel value corresponding to the target person in the course collection data, determining the explanation paragraph, and highlighting the explanation paragraph in the courseware data based on the preset mark.

[0085] It should be noted that the actual instructor can wear a special pair of gloves. For example, the color of the fingers of the gloves is inconsistent with the color of the rest of the gloves. Therefore, when the instructor explains the course content, he may focus on some content. Therefore, this solution can recognize the instructor's hand posture and automatically determine the recognition method for marking and displaying the course data, so as to automatically determine the content indicated by the instructor according to the position trajectory of different pixels and highlight it for online course students to watch.

[0086] It is not difficult to understand that the instructor may focus on explaining a section of the course content being presented, and therefore, a hand gesture corresponding to indicating the section may be made, thereby responding to the corresponding method for identifying and marking the section.

[0087] It can be understood that the teacher's end is the hand wearing specific gloves corresponding to the lecturer, and the paragraph display information is the information that marks and displays the paragraph indicated by the hand, for example, in the form of five fingers open, or after the lecturer triggers the paragraph display button, the paragraph pointed to by the lecturer will be recorded, and the focus pixel value is the color pixel value of the finger on the glove, for example, it can be red, and the explanation paragraph is the content paragraph that needs to be highlighted for key explanation. The preset mark is a pre-set mark form, for example, it can be a marking line, or a highlight mark color, etc., so as to mark and display the explanation paragraph for easy viewing by people.

[0088] For example: when the instructor's hand gesture is recognized as indicating a paragraph, the position of the focus pixel value corresponding to the target person in the course collection data can be analyzed to determine the explanation paragraph, and the corresponding explanation paragraph in the courseware data can be marked with a preset underline to highlight it.

[0089] It is worth mentioning that the target person in the actual recorded course collection data wears specific gloves. For the viewing aesthetics of the online course, the hands of the corresponding character model do not have glove information.

[0090] In some embodiments, the specific implementation of step S2 (the response to the paragraph display information of the teacher end, analyzing the position of the focus pixel value corresponding to the target person in the course collection data, determining the explanation paragraph, and highlighting the explanation paragraph in the courseware data based on the preset mark) includes:

[0091] S21, responding to the paragraph display information of the teacher end, counting the trajectory coordinates of the focus pixel values ​​corresponding to the target person in the course collection data in the teaching area to obtain a trajectory coordinate set.

[0092] It is understandable that during the lecture, the instructor can indicate the location of the lecture paragraph in the courseware data by moving his hands. Therefore, the trajectory coordinates of the focus pixel values ​​corresponding to the target person in the course collection data in the teaching area can be counted to obtain the trajectory coordinate set of the corresponding hand in the teaching area.

[0093] Among them, the teaching area is the course content display area in the actual teaching in the course collection data, for example, the whiteboard area for displaying the courseware content, the trajectory coordinates are the position coordinates of the movement of the focus pixel value, and the trajectory coordinate set is a set containing the trajectory coordinates.

[0094] It is not difficult to understand that the hand position of the instructor may change constantly during the course explanation. When the hand is outside the teaching area, it will not affect the course content being explained. Therefore, when identifying and counting the focus pixel values ​​of the hand, only the trajectory in the teaching area can be identified and counted, that is, when the hand with the glove with the focus pixel value enters the teaching area, the trajectory coordinates are recorded, thereby reducing the amount of data processing for identifying the trajectory coordinates of the focus pixel value at any position, and improving the efficiency of determining the content of the marked paragraph.

[0095] S22, obtaining the dwell time of each track coordinate in the track coordinate set, and when it is determined that the dwell time is greater than or equal to a preset time, using the corresponding track coordinate as a positioning coordinate.

[0096] It can be understood that when the hand moves to indicate the corresponding course content, the corresponding focus pixel value has a corresponding dwell time at each position corresponding to the passed trajectory coordinates. When the dwell time is long, it can be explained that the paragraph corresponding to the corresponding coordinate position is the paragraph that the teacher needs to mark.

[0097] The dwell time is the length of time the corresponding position is stayed, the preset time is a preset time, which may be 0.5s, and the positioning coordinates are the position coordinates of the paragraph to be marked.

[0098] For example: when the trajectory coordinate set is {(5, -1), (4, 0), (4, 1), (3, 1), (2, 2)}, the corresponding trajectory coordinate (5, -1) stays for 0.01s, the trajectory coordinate (4, 0) stays for 0.01s, the trajectory coordinate (4, 1) stays for 0.01s, the trajectory coordinate (3, 1) stays for 0.01s, the trajectory coordinate (2, 2) stays for 1s, and the preset time is 0.5s. Since 1s>0.5s, the corresponding trajectory coordinate (2, 2) can be used as the positioning coordinate.

[0099] Through the above implementation, the present invention can obtain the positioning coordinates, so that the explanation paragraphs to be highlighted can be determined according to the positioning coordinates later, so that students can focus on watching them.

[0100] S23, determining the font coordinates in the teaching area according to the font pixel values, performing calculation based on the positioning coordinates and the font coordinates to obtain the positioning distance, determining the font paragraph corresponding to the font coordinates with the shortest positioning distance as the explanation paragraph, and highlighting the explanation paragraph in the courseware data according to the preset mark.

[0101] It should be noted that the explanation paragraph that needs to be marked can be determined based on the position of the finger's positioning coordinates in the teaching area, and the paragraph closest to the positioning coordinates can be used as the explanation paragraph. Therefore, the content paragraph closest to the positioning coordinates can be determined based on the font coordinates.

[0102] It can be understood that the font pixel value is the pixel value of the font of the course content, which can be black, the font coordinates are the coordinates of the displayed content font, the positioning distance is the distance between the positioning coordinates and the font coordinates, and the font paragraph is the paragraph in the displayed course content.

[0103] It is worth mentioning that since there are a large number of fonts in the course content in the teaching area, it is possible to obtain only the font coordinates of the first and last fonts of each line, thereby calculating the positioning distance of the corresponding font coordinates, greatly reducing the amount of data processing. The paragraph corresponding to the font coordinates with the shortest positioning distance can be used as the explanation paragraph, and then the preset mark underline can be used to highlight the explanation paragraph for subsequent viewing.

[0104] It should be noted that when the teacher is explaining the course content, the finger position may move back and forth slightly in the area near the explanation paragraph, so that there are repeated trajectory coordinates in the trajectory coordinate set, and the statistical trajectory coordinates The stay time is less than the preset time, in order to accurately determine the corresponding explanation paragraph that needs to be marked, the positioning area can be determined according to the repeated trajectory coordinates in the trajectory coordinate set, so as to further analyze and obtain the explanation paragraph. Therefore, it specifically includes:

[0105] A1, when it is determined that the stay duration is less than the preset duration, the repeated trajectory coordinates in the trajectory coordinate set are obtained as positioning coordinates, and adjacent positioning coordinates are counted to obtain a positioning area.

[0106] It can be understood that the repeated trajectory coordinates in the trajectory coordinate set are used as positioning coordinates, so that the corresponding positioning area can be determined according to the largest horizontal coordinate and vertical coordinate and the smallest horizontal coordinate and vertical coordinate in the multiple positioning coordinates.

[0107] Among them, the positioning area is the area for determining the position indicated by the finger. For example, when the maximum value of the horizontal coordinate in multiple positioning coordinates is 3, the minimum value is 2, and the maximum value of the vertical coordinate is 3, and the minimum value is 2, then the rectangular area enclosed by the line segments corresponding to the maximum horizontal and vertical coordinates and the minimum horizontal and vertical coordinates can be obtained as the positioning area.

[0108] A2, obtaining the coordinates of the center point corresponding to the positioning area as the midpoint coordinates of the area, and determining the font coordinates in the teaching area according to the font pixel value.

[0109] It can be understood that the coordinates of the center point of the region are the coordinates of the center point corresponding to the positioning region.

[0110] Through the above implementation, the present invention can obtain the coordinates of the center point of the area and the font coordinates, so as to calculate the corresponding judgment distance later, thereby determining the corresponding explanation paragraph and highlighting it for people to watch.

[0111] A3, based on the midpoint coordinates of the area and the font coordinates, a judgment distance is obtained, and the font paragraph corresponding to the font coordinates of the shortest judgment distance is determined as the explanation paragraph, and the explanation paragraph in the courseware data is highlighted according to the preset mark.

[0112] It can be understood that the determination distance is the distance between the coordinates of the midpoint of the region and the coordinates of each font.

[0113] It is not difficult to understand that the font paragraph with the shortest coordinates of the regional midpoint in the distance positioning area is the explanation paragraph that the instructor needs to mark, so the font paragraph with the font coordinates corresponding to the shortest judgment distance can be underlined and highlighted as the explanation paragraph.

[0114] For example, when the font coordinates corresponding to the shortest judgment distance are located in the third line of the font paragraph, the third line of the font paragraph can be used as the explanation paragraph.

[0115] S3, in response to the box selection display information on the teacher side, analyze the movement trajectory of the focus pixel value corresponding to the target person in the course collection data, determine the explanation segment in the courseware data, and highlight the explanation segment in the courseware data based on the preset mark.

[0116] It is understandable that when the instructor may need to focus on explaining more content, the instructor can choose to select the key content by framing, so that the corresponding content can be circled and framed.

[0117] Among them, the explanation segment is the content segment that needs to be highlighted in the courseware data, such as the content segment between the fourth and fifth lines.

[0118] It is not difficult to understand that when the instructor's hand form is in a posture corresponding to the frame selection method, the present invention can recognize the corresponding frame selection display information and respond, or it can trigger the frame selection display button, thereby analyzing the movement trajectory of the focus pixel value corresponding to the target person in the course collection data, determining the explanation segment in the courseware data, and then highlighting it for people to watch.

[0119] In some embodiments, the specific implementation of step S3 (the response to the box selection display information of the teacher end, analyzing the movement trajectory of the target person corresponding to the focus pixel value in the course collection data, determining the explanation segment in the courseware data, and highlighting the explanation segment in the courseware data based on the preset mark) includes:

[0120] S31, responding to the frame selection display information of the teacher end, obtaining the moving trajectory of the focus pixel value corresponding to the target person in the course collection data in the teaching area.

[0121] It can be understood that the frame selection display information is the hand form information of the frame selection method. Since the instructor circles and selects the corresponding content that needs to be highlighted according to the frame selection method, the frame selection trajectory of the target person's finger can be obtained, so that the movement trajectory of the focus pixel value in the teaching area can be identified.

[0122] The moving trajectory is the moving position trajectory of the target person's finger having the focus pixel value.

[0123] It is not difficult to understand that, since the movement trajectory outside the teaching area will not affect the determination of the explanation segment, only the movement trajectory in the teaching area can be obtained, which can reduce the amount of data processing.

[0124] Through the above implementation, the present invention can obtain the moving trajectory of the focus pixel value, so as to analyze the moving trajectory and determine the corresponding explanation segment, so as to highlight and mark it.

[0125] S32, deleting and updating the movement track according to the frame selection area strategy to obtain a frame selection area.

[0126] It can be understood that once the focus pixel value corresponding to the lecturer enters the teaching area, the corresponding movement trajectory begins to be counted, such as Figure 2 As shown, the movement tracks in the course collection data will be processed. There may be tracks without content marking in the movement tracks. Therefore, it is necessary to delete and update the redundant tracks to determine the framed area so that the explanation segments can be obtained later and highlighted for people to watch.

[0127] The framed area is the area where the explanation segment is framed.

[0128] In some embodiments, a specific implementation of step S32 (deleting and updating the movement trajectory according to the frame selection area strategy to obtain the frame selection area) includes:

[0129] S321, extracting repeated coordinates in the movement trajectory as repeated coordinates, determining the first repeated coordinate in the movement trajectory as the first interception coordinate, and determining the second repeated coordinate in the movement trajectory as the second interception coordinate.

[0130] It can be understood that when a finger with a focus pixel value is used to circle and select, the corresponding moving trajectory will have a closed area, and then the corresponding position points will overlap, and the corresponding coordinates will also be repeated, so that the repeated coordinates can be used as repeated coordinates. For example, when the corresponding coordinates in the moving trajectory obtained according to the change in time are (8, -4), (7, -3), (6, -2), (5, -1), (4, 0), (5, 1), (5, 0), (5, -1), (3, -2), the corresponding repeated coordinates are (5, -1).

[0131] It is not difficult to understand that the first repeated coordinates appearing in the moving trajectory can be the starting point coordinates of the closed area, and the second repeated coordinates appearing can be the end point of the closed area of ​​the moving trajectory. Therefore, in order to obtain the corresponding framed area and eliminate the misleading of redundant trajectories in determining the explanation segment, the first repeated coordinates can be used as the first interception coordinates, and the second repeated coordinates can be used as the second interception coordinates, so as to facilitate the subsequent deletion and update of the moving trajectory.

[0132] It is worth mentioning that the corresponding coordinates in the moving trajectory may have repeated coordinates, but since the time of moving to each position coordinate is different, the arrangement order of the corresponding trajectory coordinates can be obtained according to the time, thereby determining the first interception coordinates and the second interception coordinates.

[0133] S322, determining the coordinates of the movement trajectory located in front of the first interception coordinates as the initial interception coordinates, and determining the coordinates of the movement trajectory located in the rear of the second interception coordinates as the final interception coordinates.

[0134] It can be understood that the initial interception coordinates are the coordinates of the movement trajectory located in front of the first interception coordinates, and the final interception coordinates are the coordinates of the movement trajectory located behind the second interception coordinates.

[0135] For example: when the position coordinates corresponding to the moving trajectory are (8, -4), (7, -3), (6, -2), (5, -1), (4, 0), (5, 1), (5, 0), (5, -1), (3, -2), the initial interception coordinates are (8, -4), (7, -3), (6, -2), and the final interception coordinates are (3, -2).

[0136] Through the above implementation, the present invention can obtain the tenth interception coordinates and the last interception coordinates, so as to facilitate the subsequent deletion and update of the movement trajectory.

[0137] S323: Deleting and updating the movement track according to the initial interception coordinates and the final interception coordinates to obtain a framed area.

[0138] It can be understood that the initial interception coordinates and the final interception coordinates in the coordinates corresponding to the movement trajectory are updated and deleted, and the area surrounded by the updated movement trajectory is the frame selection area.

[0139] Through the above implementation, the present invention can obtain the framed area, so as to determine the corresponding explanation segment according to the framed area in the subsequent process, and then highlight it for easy viewing by personnel.

[0140] S33, based on the framed area, the font paragraphs in the teaching area are intercepted and processed to obtain the explanation segments corresponding to the courseware data, and the explanation segments in the courseware data are highlighted and displayed based on preset marks.

[0141] It is understandable that the font paragraphs in the framed area are intercepted to obtain explanation segments, so that the corresponding explanation segments in the courseware data in the preset interface are highlighted and displayed, so that people can intuitively view the key explanation content.

[0142] In some embodiments, the specific implementation of step S33 (the interception processing of the font paragraphs in the teaching area based on the framed area to obtain the explanation segment corresponding to the courseware data) includes:

[0143] S331, determining the font paragraph in the framed area as a paragraph to be processed, and constructing a positioning underline below the paragraph to be processed.

[0144] It can be understood that the paragraph to be processed is a font paragraph within the framed area, and the positioning underline is a positioning line for determining the intercepted explanation segment, which can be a horizontal line constructed under the corresponding font paragraph.

[0145] For example: when the selection area includes the third, fourth and fifth lines of font paragraphs, the third, fourth and fifth lines of font paragraphs can be treated as paragraphs to be processed, and positioning underlines can be constructed under the third, fourth and fifth lines of font paragraphs to facilitate subsequent identification of the explanation segments.

[0146] S332: Taking the intersection of the framed area and the positioning underline as the intersection to be processed, and constructing a positioning vertical line perpendicular to the positioning underline based on the intersection to be processed.

[0147] It can be understood that the intersection to be processed is the intersection of the frame selection area and the positioning underline, and the positioning vertical line is a line segment passing through the intersection to be processed and perpendicular to the positioning underline.

[0148] It is worth mentioning that each intersection to be processed on each line of the font paragraph has a corresponding positioning vertical line, and the positioning vertical line will not be too long to intersect with other font paragraphs.

[0149] Through the above implementation, the present invention can obtain the positioning vertical lines corresponding to each positioning underline, so as to determine the accurate explanation segment according to the positioning vertical lines and perform highlighting.

[0150] S333, when it is determined that the positioning vertical line has a font intersecting with it in the corresponding paragraph to be processed, the corresponding font is used as the font to be judged, and the number of pixel points of the font to be judged corresponding to the font pixel value in the frame selection area is obtained as the interception number.

[0151] It is understandable that if Figure 3 As shown, when the positioning vertical line intersects with the font in the paragraph to be processed, the corresponding font can be used as the font to be judged. In order to determine whether the font to be judged belongs to or not in the content of the explanation segment, the number of pixel points of the corresponding font pixel value in the selected area of ​​the font to be judged can be obtained. When the number of pixel points in the selected area is large and the corresponding text accounts for a large proportion of the selected area, the corresponding font can be determined as the text content in the explanation segment, thereby accurately highlighting the mark.

[0152] Among them, the font pixel value is the pixel value of the font, which can be black, the number of pixels is the number of pixels, and the interception number is the number of pixels corresponding to the font pixel value in the frame selection area.

[0153] S334, determining the number of pixel points of the font pixel value corresponding to the to-be-determined font as the total number, and obtaining the interception ratio according to the ratio of the intercepted number to the total number.

[0154] It can be understood that the total number is the number of pixel points of the font pixel value corresponding to the font to be determined, and the interception ratio is the ratio of the interception number to the total number.

[0155] Through the above implementation, the present invention can obtain the interception ratio corresponding to the font to be determined, so as to determine the corresponding explanation segment according to the interception ratio later.

[0156] S335: When it is determined that the interception ratio is greater than the preset ratio, the corresponding font to be determined is used as the interception font.

[0157] It can be understood that the preset proportion is a pre-set proportion value, such as 1 / 2. When the interception proportion is greater than the preset proportion, it can be explained that the proportion of the corresponding font to be judged in the selected area is relatively large, so there is a high probability that it is the content of the explanation segment that the lecturer needs to mark. Therefore, the judgment font can be used as the interception font to highlight the subsequent intercepted explanation segment.

[0158] The intercepted font is a font to be determined whose interception ratio is greater than a preset ratio.

[0159] S336, when it is determined that the positioning vertical line has no font intersecting with it in the corresponding paragraph to be processed, the two fonts closest to the positioning vertical line in the corresponding paragraph to be processed are used as fonts to be selected, and the font to be selected located in the frame selection area is determined as the intercepted font.

[0160] It is understandable that if Figure 4 As shown, when there is no font intersecting with the positioning vertical line in the paragraph to be processed, the two fonts closest to the positioning vertical line in the corresponding paragraph to be processed can be determined, and the corresponding two fonts can be used as fonts to be selected, so that the font to be selected can be analyzed and selected again, and the font to be selected located in the framed area can be determined as the intercepted font.

[0161] The fonts to be selected are the two fonts that are closest to the positioning vertical line in the corresponding paragraph to be processed, and the intercepted font is the font to be selected that is located in the frame selection area.

[0162] For example, when the distances between fonts A and B are closest to the positioning vertical line, fonts A and B can be used as fonts to be selected, and when font A is within the selection area, font A can be used as the intercepted font.

[0163] S337, based on the intercepted font, the corresponding font paragraph is intercepted to obtain the explanation segment within the framed area.

[0164] It is understandable that when the font is determined to be intercepted, the font paragraph can be intercepted to obtain all the explanation segments within the framed area, and then the explanation segments are highlighted and displayed so that subsequent students can intuitively view the key marked content.

[0165] S4, according to the network connection rate of each student terminal and the preset normal rate, the abnormal playback rate is obtained, the update point is optimized according to the abnormal playback rate and the point optimization strategy, and an optimized display interface is generated and sent to the corresponding student terminal.

[0166] It is understandable that when students are watching a course, the course playback may be abnormal due to network factors. Therefore, the update points that change in real time can be optimized according to the abnormal situation. For example, the change of the update points can be reduced so that the picture will not be confused due to the constant change of the update points, thereby affecting students' viewing of the course.

[0167] Therefore, the update points can be optimized according to the network connection rate and point optimization strategy of the student end, so as to generate an optimized display interface and send it to the student end to improve the students' viewing experience.

[0168] Among them, the student end is the information terminal of the course learners, which can be a computer or a mobile phone. The network connection rate is the network transmission rate, which is a factor in judging the quality of the network. The optimized display interface is the course display interface obtained after optimizing the update points.

[0169] In some embodiments, the specific implementation of step S4 (obtaining the abnormal playback rate according to the network connection rate of each student terminal and the preset normal rate, optimizing the update point according to the abnormal playback rate and the point optimization strategy, and generating an optimized display interface to send to the corresponding student terminal) includes:

[0170] S41, obtaining the network connection rate of each student terminal, and when it is determined that the network connection rate is less than a preset normal rate, obtaining the abnormal playback rate according to the difference between the preset normal rate and the network connection rate.

[0171] It is understandable that when the network connection rate is lower than the preset normal rate, it means that the network speed of the corresponding student end is slow. When multiple update points are changed in real time, abnormal picture playback may occur, such as chaotic picture, or inconsistency between explanation content and display content. Therefore, the abnormal playback rate can be obtained based on the difference between the preset normal rate and the network connection rate, so as to optimize the update positioning according to the abnormal playback rate and ensure that the interface sent to each student end can be played and viewed normally.

[0172] The preset normal rate is a network rate pre-set according to actual conditions, and the abnormal playback rate is the difference between the preset normal rate and the network connection rate.

[0173] S42, obtaining a point adjustment quantity based on a ratio of the abnormal playback rate to a preset point rate.

[0174] It can be understood that the preset point rate is a preset rate value, and the preset point rate has a corresponding number of update points. For example, when the preset point rate is 10Kbps, it corresponds to 1 update point, that is, for every difference of 10Kbps, 1 update point is adjusted accordingly.

[0175] The point adjustment quantity refers to the number of adjustments made to the update points.

[0176] For example, when the abnormal playback rate is 50 Kbps and the preset point rate is 10 Kbps, the point adjustment number can be 50 / 10=5, so that 5 update points in the character model corresponding to the target character can be selected for optimization adjustment.

[0177] The step of obtaining the point adjustment quantity based on the ratio of the abnormal playback rate to the preset point rate includes:

[0178]

[0179] Among them, n adj is the point adjustment quantity, s con is the preset normal rate, s rea is the network connection rate, y pre is the preset point rate, n pre The number of preset points.

[0180] It is understandable that when the network connection rate is smaller, the corresponding abnormal playback rate will be larger, and thus the number of point adjustments will be larger. Among them, the preset point rate has a corresponding preset point number. For example, 100kb / s corresponds to one point. For the sake of ease of understanding, only an example is given here.

[0181] S43, obtaining a preset priority corresponding to each of the update points, and sorting the update points in ascending order based on the preset priority to obtain an update sequence.

[0182] It is understandable that the update points will be prioritized in advance according to the degree of impact their locations have on the teaching content. For example, the explanation paragraph or segment to be highlighted can be determined by the position of the hand, so the update point at the hand position is more important and has a higher priority setting.

[0183] It is not difficult to understand that the preset priority is the priority set in advance for the update point, and the update sequence is the point sequence after the update points are sorted in ascending order according to the preset priority.

[0184] Through the above implementation, the present invention can obtain a corresponding update sequence, so as to select a corresponding update point in the update sequence for subsequent optimization adjustment.

[0185] S44, selecting an update point in the update sequence as a pause point according to the point adjustment quantity, and deleting and updating the update sequence based on the pause point to obtain a real-time sequence.

[0186] It can be understood that the pause point is the update position selected in the update sequence according to the number of point adjustments. For example, when the number of point adjustments is 5 and the update sequence is (update point 1, update point 2, update point 3, update point 4, update point 5, update point 6, update point 7), then 5 update points can be selected in the update sequence in turn as pause points, so that the corresponding pause points are update point 1, update point 2, update point 3, update point 4, and update point 5.

[0187] Among them, the real-time sequence is the updated sequence after deleting the pause points in the update sequence. For example, when the update sequence is (update point 1, update point 2, update point 3, update point 4, update point 5, update point 6, update point 7), and the pause points are update point 1, update point 2, update point 3, update point 4, update point 5, then the real-time sequence can be obtained as (update point 6, update point 7).

[0188] Through the above implementation, the present invention can obtain a real-time sequence, so as to optimize and adjust the preset interface in real time, improve the course playback quality on the student side, and facilitate learning and viewing of personnel.

[0189] S45, obtaining the position data of the updated point in the real-time sequence corresponding to the target person in the course collection data, updating the character model corresponding to the target person to a preset interface based on the position data, generating an optimized display interface and sending it to the corresponding student terminal.

[0190] It can be understood that the position data of the update point in the corresponding real-time sequence is obtained, and then the corresponding update point in the corresponding character model is updated at the same position according to the position data. For example, when the position data of the update point 6 in the real-time sequence corresponding to the target character in the course collection data is the coordinate (6, 2), then the update point 6 corresponding to the character model can be updated at the coordinate (6, 2) position in the preset interface, and an optimized display interface is generated, which is then sent to the student end to improve the video playback quality and facilitate student viewing.

[0191] See also Figure 5 , is a structural diagram of a digital network course playback abnormality monitoring device provided by an embodiment of the present invention, the digital network course playback abnormality monitoring device comprises:

[0192] A retrieval module is used to retrieve courseware data and update it to the courseware area in the preset interface, and obtain the position data of the target person corresponding to the update point in the course collection data, and update the character model corresponding to the target person to the preset interface based on the position data;

[0193] An analysis module, which is used to respond to the paragraph display information of the teacher end, analyze the position of the focus pixel value corresponding to the target person in the course collection data, determine the explanation paragraph, and highlight the explanation paragraph in the courseware data based on the preset mark;

[0194] A determination module, which is used to respond to the box selection display information of the teacher end, analyze the movement trajectory of the focus pixel value corresponding to the target person in the course collection data, determine the explanation segment in the courseware data, and highlight the explanation segment in the courseware data based on the preset mark;

[0195] A generation module is used to obtain the abnormal playback rate according to the network connection rate of each student terminal and the preset normal rate, optimize the update point according to the abnormal playback rate and the point optimization strategy, and generate an optimized display interface to send to the corresponding student terminal.

[0196] The present invention also provides a readable storage medium, in which a computer program is stored. When the computer program is executed by a processor, it is used to implement the methods provided by the various embodiments described above.

[0197] Among them, the readable storage medium can be a computer storage medium or a communication medium. The communication medium includes any medium that facilitates the transmission of a computer program from one place to another. The computer storage medium can be any available medium that can be accessed by a general-purpose or special-purpose computer. For example, a readable storage medium is coupled to a processor so that the processor can read information from the readable storage medium and write information to the readable storage medium. Of course, the readable storage medium can also be a component of the processor. The processor and the readable storage medium can be located in an application-specific integrated circuit (Application Specific Integrated Circuits, abbreviated as: ASIC). In addition, the ASIC can be located in a user device. Of course, the processor and the readable storage medium can also exist in a communication device as discrete components. The readable storage medium can be a read-only memory (ROM), a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, and an optical data storage device, etc.

[0198] The present invention also provides a program product, which includes an execution instruction, which is stored in a readable storage medium. At least one processor of a device can read the execution instruction from the readable storage medium, and at least one processor executes the execution instruction so that the device implements the methods provided in the above various embodiments.

[0199] In the embodiments of the above-mentioned devices, it should be understood that the processor may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), etc. The general-purpose processor may be a microprocessor or any conventional processor. The steps of the method disclosed in the present invention may be directly implemented as being executed by a hardware processor, or may be executed by a combination of hardware and software modules in the processor.

[0200] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or replace some or all of the technical features therein with equivalents. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present invention.

Claims

1. A method for monitoring abnormal playback of digital online courses, characterized in that: include: Retrieving courseware data to update to a courseware area in a preset interface, and obtaining location data of a target person corresponding to an update point in the course collection data, and updating a character model corresponding to the target person to the preset interface based on the location data, wherein the courseware area is an area in the preset interface that displays courseware content; In response to the paragraph display information of the teacher end, the position of the focus pixel value corresponding to the target person in the course collection data is analyzed to determine the explanation paragraph, and the explanation paragraph in the courseware data is highlighted based on the preset mark; In response to the box selection display information of the teacher end, the moving trajectory of the focus pixel value corresponding to the target person in the course collection data is analyzed, the explanation segment in the courseware data is determined, and the explanation segment in the courseware data is highlighted based on the preset mark; According to the network connection rate of each student terminal and the preset normal rate, the abnormal playback rate is obtained, the update point is optimized according to the abnormal playback rate and the point optimization strategy, and an optimized display interface is generated and sent to the corresponding student terminal; The method of obtaining the abnormal playback rate according to the network connection rate of each student terminal and the preset normal rate, optimizing the update point according to the abnormal playback rate and the point optimization strategy, and generating an optimized display interface to send to the corresponding student terminal includes: Obtaining the network connection rate of each student terminal, and when determining that the network connection rate is less than a preset normal rate, obtaining the abnormal playback rate according to the difference between the preset normal rate and the network connection rate; Based on the ratio of the abnormal playback rate to the preset point rate, obtaining the point adjustment quantity; Obtaining a preset priority corresponding to each of the update points, and sorting the update points in ascending order based on the preset priority to obtain an update sequence; Selecting an update point in the update sequence as a pause point according to the point adjustment quantity, and deleting and updating the update sequence based on the pause point to obtain a real-time sequence; The position data of the updated points in the real-time sequence corresponding to the target person in the course collection data are obtained, the character model corresponding to the target person is updated to a preset interface based on the position data, and an optimized display interface is generated and sent to the corresponding student terminal.

2. The method according to claim 1, characterized in that: The process of retrieving courseware data and updating it to a courseware area in a preset interface, obtaining position data of an update point corresponding to a target person in the course collection data, and updating a character model corresponding to the target person to the preset interface based on the position data includes: Retrieve courseware data and update it to the courseware area in the preset interface, and receive course collection data collected by the collection device; Based on OpenCV, the update point corresponding to the target person in the course collection data is obtained, and the center point of the course collection data is obtained as the collection center point, a coordinate system is constructed based on the collection center point, and the coordinates corresponding to the update point are determined as position data; The center point of the preset interface is obtained as the playback center point, and a coordinate system is constructed based on the playback center point, and the character model corresponding to the target character is updated to the preset interface based on the position data.

3. The method according to claim 1, characterized in that The responding to the paragraph display information of the teacher end, analyzing the position of the focus pixel value corresponding to the target person in the course collection data, determining the explanation paragraph, and highlighting the explanation paragraph in the courseware data based on the preset mark, includes: In response to the paragraph display information of the teacher end, the trajectory coordinates of the focus pixel value corresponding to the target person in the course collection data in the teaching area are counted to obtain a trajectory coordinate set, wherein the teaching area is a display area for explaining the course content in the course collection data; Obtaining the dwell time of each track coordinate in the track coordinate set, and when it is determined that the dwell time is greater than or equal to a preset time, using the corresponding track coordinate as a positioning coordinate; The font coordinates in the teaching area are determined according to the font pixel values, and the positioning distance is obtained by calculation based on the positioning coordinates and the font coordinates. The font paragraph corresponding to the font coordinates with the shortest positioning distance is determined as the explanation paragraph, and the explanation paragraph in the courseware data is highlighted according to the preset mark.

4. The method according to claim 3, characterized in that Also includes: When it is determined that the stay durations are all less than the preset duration, obtaining repeated trajectory coordinates in the trajectory coordinate set as positioning coordinates, and counting adjacent positioning coordinates to obtain a positioning area; Obtaining the coordinates of the center point corresponding to the positioning area as the coordinates of the midpoint of the area, and determining the font coordinates in the teaching area according to the font pixel value; A calculation is performed based on the midpoint coordinates of the region and the font coordinates to obtain a judgment distance, and the font paragraph corresponding to the font coordinates of the shortest judgment distance is determined as the explanation paragraph. The explanation paragraph in the courseware data is highlighted according to a preset mark.

5. The method according to claim 1, characterized in that The responding to the frame selection display information of the teacher end, analyzing the moving trajectory of the focus pixel value corresponding to the target person in the course collection data, determining the explanation segment in the courseware data, and highlighting the explanation segment in the courseware data based on the preset mark, includes: In response to the box selection display information of the teacher end, a moving trajectory of the focus pixel value corresponding to the target person in the course collection data in the teaching area is obtained; Deleting and updating the movement trajectory according to the frame selection area strategy to obtain the frame selection area; Based on the framed area, the font paragraphs in the teaching area are intercepted and processed to obtain the explanation segments corresponding to the courseware data, and based on the preset marks, the explanation segments in the courseware data are highlighted and displayed.

6. The method according to claim 5, characterized in that The step of deleting and updating the movement track according to the frame selection area strategy to obtain the frame selection area includes: Extracting repeated coordinates in the movement trajectory as repeated coordinates, determining the first repeated coordinate in the movement trajectory as the first intercepted coordinate, and determining the second repeated coordinate in the movement trajectory as the second intercepted coordinate; Determine the coordinates of the movement trajectory located in front of the first interception coordinates as the initial interception coordinates, and determine the coordinates of the movement trajectory located in the rear of the second interception coordinates as the final interception coordinates; The movement track is deleted and updated according to the initial interception coordinates and the final interception coordinates to obtain a framed area.

7. The method according to claim 6, characterized in that The intercepting and processing of the font paragraphs in the teaching area based on the framed area to obtain the explanation segments corresponding to the courseware data includes: Determine the font paragraph in the framed area as a paragraph to be processed, and construct a positioning underline below the paragraph to be processed; The intersection of the framed area and the positioning underline is used as the intersection to be processed, and a positioning vertical line perpendicular to the positioning underline is constructed based on the intersection to be processed; When it is determined that the positioning vertical line has a font intersecting with the corresponding paragraph to be processed, the corresponding font is used as the font to be determined, and the number of pixel points of the font to be determined corresponding to the font pixel value within the frame selection area is obtained as the interception number; Determine the number of pixel points of the font pixel value corresponding to the font to be determined as the total number, and obtain the interception ratio according to the ratio of the intercepted number to the total number; When it is determined that the interception ratio is greater than the preset ratio, the corresponding font to be determined is used as the interception font; When it is determined that the positioning vertical line has no font intersecting with it in the corresponding paragraph to be processed, two fonts closest to the positioning vertical line in the corresponding paragraph to be processed are used as fonts to be selected, and the font to be selected located in the frame selection area is determined as the intercepted font; Based on the intercepted font, the corresponding font paragraph is intercepted to obtain the explanation segment within the framed area.

8. The method according to claim 1, characterized in that: The step of obtaining the point adjustment quantity based on the ratio of the abnormal playback rate to the preset point rate includes: Among them, n adj is the point adjustment quantity, s con is the preset normal rate, s rea is the network connection rate, y pre is the preset point rate, n pre The number of preset points.

9. A digital network course playback abnormality monitoring device, characterized in that: include: A retrieval module is used to retrieve courseware data and update it to a courseware area in a preset interface, and obtain the position data of the target person corresponding to the update point in the course collection data, and update the character model corresponding to the target person to the preset interface based on the position data, wherein the courseware area is an area in the preset interface that displays the courseware content; An analysis module, which is used to respond to the paragraph display information of the teacher end, analyze the position of the focus pixel value corresponding to the target person in the course collection data, determine the explanation paragraph, and highlight the explanation paragraph in the courseware data based on the preset mark; A determination module, which is used to respond to the box selection display information of the teacher end, analyze the movement trajectory of the focus pixel value corresponding to the target person in the course collection data, determine the explanation segment in the courseware data, and highlight the explanation segment in the courseware data based on the preset mark; A generation module is used to obtain the abnormal playback rate according to the network connection rate of each student terminal and the preset normal rate, optimize the update point according to the abnormal playback rate and the point optimization strategy, generate an optimized display interface and send it to the corresponding student terminal; the abnormal playback rate is obtained according to the network connection rate of each student terminal and the preset normal rate, optimize the update point according to the abnormal playback rate and the point optimization strategy, generate an optimized display interface and send it to the corresponding student terminal, including: Obtaining the network connection rate of each student terminal, and when determining that the network connection rate is less than a preset normal rate, obtaining the abnormal playback rate according to the difference between the preset normal rate and the network connection rate; Based on the ratio of the abnormal playback rate to the preset point rate, obtaining the point adjustment quantity; Obtaining a preset priority corresponding to each of the update points, and sorting the update points in ascending order based on the preset priority to obtain an update sequence; Selecting an update point in the update sequence as a pause point according to the point adjustment quantity, and deleting and updating the update sequence based on the pause point to obtain a real-time sequence; The position data of the updated points in the real-time sequence corresponding to the target person in the course collection data are obtained, the character model corresponding to the target person is updated to a preset interface based on the position data, and an optimized display interface is generated and sent to the corresponding student terminal.

Images