A coking detection method, a detection device and a computer readable storage medium
By obtaining the video resolution and pixel information of the display screen to determine the stuttering status, the problem of the limited applicability of existing stuttering detection methods is solved, the accuracy and response speed of detection are improved, and the user experience is enhanced.
Patent Information
- Application Number
- CN202210006613.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-01-05
- Publication Date
- 2025-11-21
- Estimated Expiration
- 2042-01-05
AI Technical Summary
Existing lag detection methods are not very applicable, causing the terminal to remain on the lag screen or even crash when no lag is detected, thus affecting the user experience.
By obtaining the resolution of the video played on the display screen, determining multiple preset positions, and obtaining the pixel information of the first and second frames of the video at these positions, the system judges whether the difference in pixel information exceeds a threshold to determine the stuttering status.
It improves the applicability and response speed of lag detection, prevents the terminal from getting stuck on the lag screen, reduces crashes, and enhances the user experience.
Smart Images

Figure CN114490215B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of display device technology, and in particular to a stuttering detection method, detection device, and computer-readable storage medium. Background Technology
[0002] Currently, users have increasingly higher demands for the smoothness of applications running on mobile phones, wearable devices, and tablets. However, as these devices offer more and more functions, the resources consumed by applications are becoming increasingly fragmented, leading to lag and stuttering when using the device. If the device doesn't detect any lag within a preset time, it may remain stuck on the lagging interface or even crash, resulting in a poor user experience.
[0003] However, existing devices determine whether stuttering occurs by calling a progress bar or checking the time. But the progress bar is positioned differently in different players, so the existing stuttering detection methods have limited applicability. Summary of the Invention
[0004] This application provides a stuttering detection method, detection device, and computer-readable storage medium, which solves the problem of limited applicability of existing stuttering detection methods.
[0005] This application provides a stuttering detection method applied to a display device, the display device including a display screen, comprising:
[0006] The resolution of the video played on the display screen is obtained, and multiple preset positions of the display screen are determined based on the resolution;
[0007] Obtain the first pixel information of the first frame of the video at multiple preset positions;
[0008] The second pixel information of the second frame of the video at multiple preset positions is obtained, and the second frame is the frame preceding the first frame;
[0009] If the difference between the first pixel information and the second pixel information does not exceed a preset threshold, then it is determined that the video played on the display screen is in a stuttering state.
[0010] Optionally, obtaining the resolution of the video played on the display screen and determining multiple preset positions of the display screen based on the resolution includes:
[0011] Obtain the target preset position and preset resolution corresponding to the display screen;
[0012] Obtain the resolution of the video;
[0013] Based on the preset resolution and the relationship between the resolutions, the target preset position is mapped to obtain the preset position.
[0014] Optionally, before obtaining the target preset position and preset resolution corresponding to the display screen, the following steps are included:
[0015] The preset image at the preset resolution is displayed on the screen;
[0016] The preset image is divided using multiple composition methods, and each composition method yields a corresponding dividing line;
[0017] By superimposing the multiple composition methods, multiple intersecting dividing lines are obtained;
[0018] Obtain multiple intersection points of the dividing lines and use these multiple intersection points as target preset positions.
[0019] Optionally, the composition methods employed include at least two of the following: the rule of thirds, the diagonal method, the symmetry method, the central method, the golden triangle method, the triangle method, or the golden spiral method.
[0020] Optionally, segmenting the preset screen using multiple composition methods includes:
[0021] The preset image is divided using a first composition method, which includes at least one of the following: the rule of thirds, the diagonal method, the symmetry method, the central method, the golden triangle method, or the golden spiral method.
[0022] After the first composition method, the triangulation method is used to segment the preset image.
[0023] Optionally, after obtaining the second frame of the video at the second pixel information at the plurality of preset positions, the method further includes:
[0024] If the difference between the first pixel information and the second pixel information exceeds a preset threshold, then extract multiple third pixel information located in non-preset positions of the first frame and extract multiple fourth pixel information located in non-preset positions of the second frame.
[0025] Determine whether the difference between the third pixel information and the fourth pixel information exceeds a preset threshold;
[0026] If the time limit is not exceeded, the video played on the display screen will be in a stuttering state.
[0027] Optional,
[0028] The first pixel information includes the first pixel coordinates corresponding to each preset position and the first pixel value corresponding to the first pixel coordinates;
[0029] The second pixel information includes the second pixel coordinates corresponding to each preset position and the second pixel value corresponding to the second pixel coordinates.
[0030] Optionally, the first pixel information includes the first pixel coordinates corresponding to each preset position, a set of first pixel coordinates of multiple pixel coordinates surrounding the first pixel coordinates, and a set of first pixel values corresponding to the set of first pixel coordinates.
[0031] The second pixel information includes the second pixel coordinates corresponding to each preset position, a set of second pixel coordinates of multiple pixel coordinates surrounding the second pixel coordinates, and a set of second pixel values corresponding to the set of second pixel coordinates.
[0032] This application embodiment also provides a detection device, including:
[0033] A preset position determination unit is used to obtain the resolution of the video played on the display screen and determine multiple preset positions of the display screen based on the resolution;
[0034] The first acquisition unit is used to acquire the first pixel information of the first frame of the video at multiple preset positions;
[0035] The second acquisition unit is used to acquire the second pixel information of the second frame of the video at multiple preset positions, wherein the second frame is the previous frame of the first frame.
[0036] The judgment unit is used to determine whether the video played on the display screen is in a stuttering state. If the difference between the first pixel information and the second pixel information does not exceed a preset threshold, then it is determined that the video played on the display screen is in a stuttering state.
[0037] This application also provides a computer-readable storage medium storing a computer program thereon, which, when executed by a processor, implements the steps of the stuttering detection method as described in any of the above claims.
[0038] The beneficial effects of this application are as follows: The stuttering detection method provided in this application obtains the resolution of the video played on the display screen, determines multiple preset positions on the display screen based on the resolution, and obtains the first pixel information of the first frame and the second pixel information of the second frame at the multiple preset positions. By comparing the first pixel information and the second pixel information of the second frame, it determines whether the video played on the display screen is in a stuttering state. By judging the stuttering of the video at multiple preset positions, it can be applied to various scenarios in television that require comparison of images, and improves the applicability of the stuttering detection method, solving the problem of low applicability of existing stuttering detection methods. Attached Figure Description
[0039] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0040] To gain a more complete understanding of this application and its beneficial effects, the following description will be provided in conjunction with the accompanying drawings. In the following description, the same reference numerals denote the same parts.
[0041] Figure 1 This is a flowchart illustrating the stuttering detection method provided in this embodiment;
[0042] Figure 2 This is a flowchart illustrating the process of establishing the relationship between a preset resolution and a preset target position in the stuttering detection method provided in this embodiment.
[0043] Figure 3 This is a schematic diagram of the mapping method in the stuttering detection method provided in this embodiment;
[0044] Figure 4 for Figure 2 The diagram shows the first schematic of the mapping method in the stuttering detection method shown;
[0045] Figure 5 for Figure 2 The diagram shown is a second schematic of the mapping method in the stuttering detection method.
[0046] Figure 6 This is a schematic diagram of the detection device provided in this embodiment. Detailed Implementation
[0047] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of this application, and not all of them. All other embodiments obtained by those skilled in the art based on the embodiments of this application without creative effort are within the scope of protection of this application.
[0048] In the description of this application, it should be understood that the terms "center," "longitudinal," "lateral," "length," "width," "thickness," "upper," "lower," "front," "rear," "left," "right," "vertical," "horizontal," "top," "bottom," "inner," "outer," "clockwise," and "counterclockwise," etc., indicating orientation or positional relationships based on the orientation or positional relationships shown in the accompanying drawings, are only for the convenience of describing this application and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, or be constructed and operated in a specific orientation, and therefore should not be construed as a limitation of this application. Furthermore, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of indicated technical features. Thus, features defined with "first" and "second" may explicitly or implicitly include one or more of the stated features. In the description of this application, "a plurality of" means two or more, unless otherwise explicitly specified.
[0049] Please see Figure 1 , Figure 1 This is a schematic diagram of the first flowchart of the stuttering detection method provided in this embodiment. This application provides a stuttering detection method applied to a display device, which includes a display screen. It is understood that the display device can be an electronic device with a built-in or external screen, such as a smartphone, tablet computer, e-book reader, or personal computer. The stuttering detection method provided in this application embodiment is as follows:
[0050] 101. Obtain the resolution of the video played on the display screen, and determine multiple preset positions of the display screen based on the resolution.
[0051] Get the resolution of the video currently playing on the display screen, and determine multiple preset positions of the current display screen based on the resolution of the current video.
[0052] It should be noted that obtaining the resolution of the currently playing video on the screen requires first retrieving the target preset position and preset resolution, then capturing the video frame, and identifying the video resolution based on the frame. Then, based on the relationship between preset resolutions, the target preset position is mapped to a preset position. For example, based on the multiple relationship between preset resolutions, the target preset position is magnified or reduced by multiples to determine multiple preset positions on the screen. It should be noted that the relationship between target preset positions and multiples of preset positions is consistent with the relationship between preset resolutions and multiples of resolutions.
[0053] Understandably, before obtaining the resolution of the video currently playing on the screen, a corresponding rule base needs to be established; that is, a correspondence needs to be established between preset resolutions and target preset positions. Please refer to the following for the specific process. Figure 2 , Figure 2 This is a flowchart illustrating the process of establishing the relationship between a preset resolution and a preset target position in the stuttering detection method provided in this embodiment.
[0054] 1011. Display the preset screen at the preset resolution on the display screen.
[0055] The screen displays a preset image at a preset resolution, or the preset resolution is obtained by recognizing the image's resolution, thus providing the current image's resolution. Common resolutions include 720×480, 1920×1080, 1366×768, 1280×720, 1024×576, and 7680×4320, among others. Users can select the appropriate resolution for the current image based on their specific needs.
[0056] For example, when users are playing videos or playing games, in order to reduce processing resources or power consumption, game applications and video players are usually compatible with multiple resolutions. If users experience screen stuttering or want to save power to extend game time while running games or playing videos, they can choose to adjust the screen resolution to a lower one. For instance, a screen might support four resolutions: 1920×1080, 1366×768, 1280×720, and 1024×576. Users can set the screen resolution to one of these options according to their needs.
[0057] Therefore, when determining whether there is stuttering in the screen, it is necessary to detect the current screen resolution in real time to ensure the accuracy of the stuttering detection method.
[0058] 1012. Multiple composition methods are used to divide the preset screen, and each composition method yields a corresponding dividing line.
[0059] The current image is divided using multiple composition methods, each resulting in a corresponding dividing line. These methods can be at least two of the following: the rule of thirds, diagonal line, symmetry, central composition, golden triangle, triangle method, or golden spiral method. It should be noted that other methods are also acceptable; no specific restrictions are imposed, and the method should be chosen based on the actual situation.
[0060] For example, the image is divided using a first composition method to obtain a first dividing line, and then the image is divided using a second composition method to obtain a second dividing line. It should be noted that the first and second composition methods are different; that is, the resulting first and second dividing lines do not coincide.
[0061] In some embodiments, the first composition method includes at least one of the rule of thirds, diagonal method, symmetry method, central method, golden triangle method, or golden spiral method, and the second composition method is the triangular method. It should be noted that when the second composition method is the triangular method, it must be implemented after the first composition method is completed. That is, the triangular method needs to be placed last because it requires the preceding composition method to locate the three points of the triangle.
[0062] 1013. By superimposing multiple composition methods, multiple intersecting dividing lines are obtained.
[0063] When combining the above composition methods, it should be noted that, except for the triangular method which should be placed last, the other composition methods can be combined in any order. For example, see [link to example]. Figure 3 , Figure 3 This is a schematic diagram of the composition method used in the stuttering detection method provided in this embodiment. This embodiment uses classic and popular photography and composition techniques to superimpose images.
[0064] Specifically, first, the image is divided into three parts using the rule of thirds, resulting in multiple first dividing lines. Then, the image is further divided using the diagonal method, resulting in multiple second dividing lines. Next, the image is divided using the golden ratio, resulting in multiple third dividing lines. Then, the image is divided using the center method, resulting in multiple fourth dividing lines. Next, the image is divided using the golden triangle method, resulting in multiple fifth dividing lines. Next, the image is divided using the golden spiral method, resulting in multiple sixth dividing lines. Finally, the image is divided using the triangle method, resulting in multiple seventh dividing lines.
[0065] Multiple composition methods are superimposed so that multiple first dividing lines, multiple second dividing lines, multiple third dividing lines, multiple fourth dividing lines, multiple fifth dividing lines, multiple sixth dividing lines, and multiple seventh dividing lines intersect in sequence.
[0066] It should be noted that this embodiment uses the above-mentioned composition methods as examples for illustration, and should not be construed as a limitation on the above composition methods. The types of composition methods and the order of superposition can be set according to actual needs, and no specific limitations are made here.
[0067] 1014. Obtain multiple intersection points of the dividing lines and use these intersection points as the target preset positions.
[0068] By sequentially intersecting the aforementioned multiple first dividing lines, multiple second dividing lines, multiple third dividing lines, multiple fourth dividing lines, multiple fifth dividing lines, multiple sixth dividing lines, and multiple seventh dividing lines, the points where the dividing lines intersect are obtained, and the corresponding target preset positions are obtained accordingly.
[0069] For example, please continue reading Figure 4 , Figure 4 for Figure 2 The diagram illustrates the first composition method in the stuttering detection approach. First, the image is divided into three parts using the rule of thirds, resulting in multiple first dividing lines. Then, the image is further divided using the diagonal method, resulting in multiple second dividing lines. These first and second dividing lines are then superimposed to obtain the intersection points; these intersection points are the points in the image most prone to change.
[0070] For example, please continue reading Figure 5 , Figure 5 for Figure 2 The diagram illustrates the second composition method in the stuttering detection approach. First, the image is divided into three parts using the rule of thirds, resulting in multiple first dividing lines. Then, the image is further divided using the diagonal method, resulting in multiple second dividing lines. Next, the image is further divided using the golden ratio, resulting in multiple third dividing lines. These first, second, and third dividing lines are then superimposed to obtain the intersection point, which is the point in the image most prone to change.
[0071] This application embodiment obtains a preset resolution by recognizing the resolution of the image, i.e., the resolution of the current image. Then, multiple composition methods are superimposed to make multiple dividing lines intersect. The points where the dividing lines intersect are extracted to determine the points in the image most prone to change, thereby obtaining the target preset position. Furthermore, this application embodiment stores the preset positions corresponding to different composition methods in corresponding rule bases. When the corresponding resolution is determined, the corresponding preset position is directly extracted from the rule base, eliminating the need to make corresponding selections based on the progress bars of different players. Therefore, this method can improve the speed of detecting stuttering, thereby improving the terminal's response speed to stuttering and enhancing the effectiveness of the stuttering detection method.
[0072] 102. Obtain the first pixel information of the first frame of the video at multiple preset positions.
[0073] The system identifies the currently playing frame in the video as the first frame and obtains the first pixel information of the first frame at multiple preset positions. The first pixel information includes the first pixel coordinates corresponding to each preset position and the first pixel value corresponding to those coordinates. It should be noted that in some embodiments, there is a certain error range between the preset positions and the actual composition. Therefore, the first pixel information can also include the first pixel coordinates corresponding to each preset position, a set of first pixel coordinates of multiple pixels surrounding the first pixel coordinates, and a set of first pixel values corresponding to the set of first pixel coordinates. For example, if the coordinates of the preset position are (x, y), then the set of pixel coordinates is a pixel circle with a diameter of ((x-5, y) to (x+5, y). It should be noted that the number 5 is only an example; the specific error value needs to be set according to the actual situation and is not specifically limited here.
[0074] 103. Obtain the second pixel information of the second frame of the video at multiple preset positions. The second frame is the frame preceding the first frame.
[0075] The system identifies the frame preceding the first frame in a video as the second frame and acquires the second pixel information of the second frame at multiple preset positions. The second pixel information includes the second pixel coordinates corresponding to each preset position and the second pixel value corresponding to those coordinates. It should be noted that in some embodiments, there is a certain error range between the preset positions and the actual composition. Therefore, the second pixel information can also be a set of second pixel coordinates including the second pixel coordinates corresponding to each preset position and the second pixel coordinates of multiple pixels surrounding those coordinates, as well as a set of second pixel values corresponding to those coordinates. For example, if the coordinates of the preset position are (x, y), then the set of pixel coordinates is a pixel circle with a diameter of ((x-5, y) to (x+5), y).
[0076] 104. If the difference between the first pixel information and the second pixel information does not exceed the preset threshold, then it is determined that the video played on the display screen is in a stuttering state.
[0077] Based on the first pixel information and the second pixel information, it is determined that the video playing on the display screen is in a stuttering state. If the difference between the first pixel information and the second pixel information does not exceed a preset threshold, it is determined that the video playing on the display screen is in a stuttering state. If the difference between the first pixel information and the second pixel information exceeds the preset threshold, further judgment is required.
[0078] Understandably, the first pixel information includes the first pixel coordinates and the first pixel value corresponding to each preset position, and the second pixel information includes the second pixel coordinates and the second pixel value corresponding to each preset position. The difference between the first and second pixel information is determined by judging the pixel values corresponding to the same pixel coordinates. If the pixel value corresponding to the coordinates in the first pixel information is the same as the pixel value corresponding to the coordinates in the second pixel information, or the difference is within a preset range, then the video played on the display screen is determined to be in a stuttering state. If the difference between the pixel value corresponding to the coordinates in the first pixel information and the pixel value corresponding to the coordinates in the second pixel information is not within the preset range, then multiple random position points need to be randomly selected, and the pixel information corresponding to the multiple random points needs to be compared to prevent incorrect judgment.
[0079] When the first pixel information includes the first pixel coordinates corresponding to each preset position and a set of first pixel coordinates of multiple pixels surrounding the first pixel coordinates, as well as a set of first pixel values corresponding to the set of first pixel coordinates, and the second pixel information includes the second pixel coordinates corresponding to each preset position and a set of second pixel coordinates of multiple pixels surrounding the second pixel coordinates, as well as a set of second pixel values corresponding to the set of second pixel coordinates, the difference between the first pixel information and the second pixel information can be determined by processing the set of pixel coordinates and the set of first and second pixel values corresponding to the set of pixel coordinates using methods such as mean difference, variance, or standard deviation, and then judging the difference between the processed pixel values. If this difference is within a preset range, it is determined that the video played on the display screen is in a stuttering state. When the difference between the pixel value corresponding to the coordinate value in the first pixel information and the pixel value corresponding to the coordinate value in the second pixel information is not within the preset range, it is necessary to arbitrarily capture multiple random position points and compare the pixel information corresponding to the multiple random points to prevent incorrect judgment.
[0080] For example, in some embodiments, if the difference between the first pixel information and the second pixel information exceeds a preset threshold, it is necessary to extract multiple third pixel information located in non-preset positions of the first frame; and extract multiple fourth pixel information located in non-preset positions of the second frame.
[0081] Determine whether the difference between the third and fourth pixel information exceeds a preset threshold; if it does not, the target application is in a lag state.
[0082] When the difference between the first and second pixel information exceeds a preset threshold, and the difference between the third and fourth pixel information also exceeds a preset threshold, it is determined that the video played on the display screen is in a non-stuttering state. This embodiment of the application, based on judging the difference between the first and second pixel information, further judges the difference between the third and fourth pixel information, which can better accommodate different screen display situations and improve the accuracy of this stuttering detection method.
[0083] This application embodiment determines multiple preset positions on the display screen based on the resolution of the video frame, and acquires the first and second pixel information of the first and second frames of the video at the preset positions. By judging the difference between the first and second pixel information, it is determined whether a preset threshold is exceeded. This application embodiment addresses the issue of background processes quickly identifying whether stuttering occurs when users are using different resolutions, improving the effectiveness of stuttering detection. Furthermore, this application embodiment does not suffer from low adaptability due to differences in the position of the progress bar in different players. When the background terminal quickly identifies stuttering, it will make corresponding adjustments, preventing the terminal from remaining on the stuttering interface or even crashing. Therefore, this stuttering detection method improves the user experience.
[0084] Please continue reading. Figure 6 , Figure 6 This is a schematic diagram of the detection device provided in this embodiment. This application also provides a detection device 100, which includes a preset position determination unit 10, a first acquisition unit 20, a second acquisition unit 30, and a judgment unit 40. The preset position determination unit 10 is used to acquire the resolution of the video played on the display screen and determine multiple preset positions of the display screen based on the resolution. The first acquisition unit 20 is used to acquire first pixel information of the first frame of the video at the multiple preset positions. The second acquisition unit 30 is used to acquire second pixel information of the second frame of the video at the multiple preset positions, wherein the second frame is the frame preceding the first frame. The judgment unit 40 is used to determine whether the video played on the display screen is in a stuttering state; if the difference between the first pixel information and the second pixel information does not exceed a preset threshold, then it is determined that the video played on the display screen is in a stuttering state.
[0085] In some embodiments, the preset position determination unit 10 is further configured to:
[0086] Retrieve the target's preset position and preset resolution;
[0087] Capture video frames and determine the video resolution based on the video frames;
[0088] Based on the preset resolution and the relationship between the resolutions, the preset position of the target is mapped to obtain the preset position.
[0089] In some embodiments, the preset position determination unit 10 is further configured to:
[0090] Display a preset image at a preset resolution on the screen;
[0091] The preset image is divided using multiple composition methods, and each composition method yields a corresponding dividing line;
[0092] By superimposing multiple composition methods, multiple intersecting dividing lines are obtained;
[0093] Obtain multiple intersection points of the dividing lines and use these intersection points as preset target positions. It should be noted that the specific overlay methods and examples of the composition technique are described in the analysis above and will not be repeated here.
[0094] In some implementations, after acquiring second pixel information of the second frame of the video at multiple preset positions, if the determination unit 40 determines that the difference between the first pixel information and the second pixel information exceeds a preset threshold, then the first acquisition unit 20 needs to extract multiple third pixel information of the first frame located at non-preset positions, and the second acquisition unit 30 needs to extract multiple fourth pixel information of the second frame located at non-preset positions. The determination unit 40 then determines whether the difference between the third pixel information and the fourth pixel information exceeds the preset threshold based on the third pixel information and the fourth pixel information; if the difference between the third pixel information and the fourth pixel information does not exceed the preset threshold, the determination unit 40 determines that the target application is in a lag state.
[0095] This application embodiment also provides a computer-readable storage medium storing a computer program thereon. When the computer program is executed by a processor, it implements the steps of the stuttering detection method described in any of the above claims, such as: obtaining the resolution of the video played on the display screen, and determining multiple preset positions of the display screen based on the resolution; obtaining first pixel information of the first frame of the video at the multiple preset positions; obtaining second pixel information of the second frame of the video at the multiple preset positions, wherein the second frame is the frame preceding the first frame; if the difference between the first pixel information and the second pixel information does not exceed a preset threshold, then it is determined that the video played on the display screen is in a stuttering state.
[0096] In the embodiments of this application, the storage medium may be a magnetic disk, an optical disk, a read-only memory (ROM), or a random access memory (RAM), etc.
[0097] In the above embodiments, the descriptions of each embodiment have different focuses. For parts not described in detail in a certain embodiment, please refer to the relevant descriptions in other embodiments.
[0098] The foregoing has provided a detailed description of a stuttering detection method, a detection device 100, and a computer-readable storage medium provided in the embodiments of this application. Specific provisions have been used to illustrate the principles and implementation methods of this application, and the descriptions of the embodiments above are only for the purpose of helping to understand this application. Furthermore, those skilled in the art will recognize that, based on the ideas of this application, there will be changes in the specific implementation methods and application scope. Therefore, the content of this specification should not be construed as a limitation of this application.
Claims
1. A stuttering detection method, applied to a display device, said display device including a display screen, characterized in that, include: The resolution of the video played on the display screen is obtained, and multiple preset positions of the display screen are determined based on the resolution; Obtain the first pixel information of the first frame of the video at multiple preset positions; The second pixel information of the second frame of the video at multiple preset positions is obtained, and the second frame is the frame preceding the first frame; If the difference between the first pixel information and the second pixel information does not exceed a preset threshold, then it is determined that the video played on the display screen is in a stuttering state. The step of obtaining the resolution of the video played on the display screen and determining multiple preset positions of the display screen based on the resolution includes: Obtain the target preset position and preset resolution corresponding to the display screen; Obtain the resolution of the video; Based on the preset resolution and the relationship between the resolutions, the preset target position is mapped to obtain the preset position; Before obtaining the target preset position and preset resolution corresponding to the display screen, the following steps are included: The preset image at the preset resolution is displayed on the screen; The preset image is divided using multiple composition methods, and each composition method yields a corresponding dividing line; By superimposing the multiple composition methods, multiple intersecting dividing lines are obtained; Obtain multiple intersection points of the dividing lines and use these multiple intersection points as target preset positions.
2. The stuttering detection method according to claim 1, characterized in that, The composition methods employed include at least two of the following: the rule of thirds, the diagonal method, the symmetry method, the central method, the golden triangle method, the triangular method, or the golden spiral method.
3. The stuttering detection method according to claim 2, characterized in that, The preset screen is segmented using multiple composition methods, including: The preset image is divided using a first composition method, which includes at least one of the following: the rule of thirds, the diagonal method, the symmetry method, the central method, the golden triangle method, or the golden spiral method. After the first composition method, the triangulation method is used to segment the preset image.
4. The stuttering detection method according to claim 1, characterized in that, After acquiring the second pixel information of the second frame of the video at multiple preset positions, the detection method further includes: If the difference between the first pixel information and the second pixel information exceeds a preset threshold, then extract multiple third pixel information located in non-preset positions of the first image, and extract multiple fourth pixel information located in non-preset positions of the second image. Determine whether the difference between the third pixel information and the fourth pixel information exceeds a preset threshold; If the time limit is not exceeded, the video played on the display screen will be in a stuttering state.
5. The stuttering detection method according to claim 1, characterized in that, The first pixel information includes the first pixel coordinates corresponding to each preset position and the first pixel value corresponding to the first pixel coordinates; The second pixel information includes the second pixel coordinates corresponding to each preset position and the second pixel value corresponding to the second pixel coordinates.
6. The stuttering detection method according to claim 1, characterized in that, The first pixel information includes the first pixel coordinates corresponding to each preset position, a set of first pixel coordinates of multiple pixel coordinates surrounding the first pixel coordinates, and a set of first pixel values corresponding to the set of first pixel coordinates. The second pixel information includes the second pixel coordinates corresponding to each preset position, a set of second pixel coordinates of multiple pixel coordinates surrounding the second pixel coordinates, and a set of second pixel values corresponding to the set of second pixel coordinates.
7. A detection device, characterized in that, include: A preset position determination unit is used to obtain the resolution of the video played on the display screen and determine multiple preset positions of the display screen based on the resolution. The first acquisition unit is used to acquire the first pixel information of the first frame of the video at multiple preset positions; The second acquisition unit is used to acquire the second pixel information of the second frame of the video at multiple preset positions, wherein the second frame is the previous frame of the first frame. The judgment unit is used to determine whether the video played on the display screen is in a stuttering state. If the difference between the first pixel information and the second pixel information does not exceed a preset threshold, then it is determined that the video played on the display screen is in a stuttering state. The preset position determination unit is used for: Obtain the target preset position and preset resolution corresponding to the display screen; Obtain the resolution of the video; Based on the preset resolution and the relationship between the resolutions, the preset target position is mapped to obtain the preset position; Before acquiring the target preset position and preset resolution corresponding to the display screen, the preset position determination unit is further configured to: The preset image at the preset resolution is displayed on the screen; The preset image is divided using multiple composition methods, and each composition method yields a corresponding dividing line; By superimposing the multiple composition methods, multiple intersecting dividing lines are obtained; Obtain multiple intersection points of the dividing lines and use these multiple intersection points as target preset positions.
8. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by the processor, it implements the steps of the stuttering detection method as described in any one of claims 1 to 6.
Citation Information
Patent Citations
Video play monitoring method and device
CN105872760A