Frame loss rate testing method, device, system, electronic device and storage medium

By comparing the recorded videos of the screen-cast videos and the picture sets of the original videos and determining the frame drop rate, the problem of the inability to efficiently test the picture quality of the screen-cast videos in the existing technology is solved, and accurate video quality evaluation and user experience improvement are achieved.

CN116193189BActive Publication Date: 2024-12-06SPREADTRUM SEMICON(CHENGDU) CO LTD
View PDF 17 Cites 0 Cited by

Patent Information

Application Number
CN202211313120.8
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-10-25
Publication Date
2024-12-06
Estimated Expiration
2042-10-25

AI Technical Summary

Technical Problem

The existing technology cannot efficiently and accurately test the frame drop rate of screen-casting videos, affecting the user experience.

Method used

By obtaining the recorded video and original video of the projected video, parsing it into a picture collection, and comparing the similarity to determine the frame drop rate, generating a statistical report, and sending it to an external device.

Benefits of technology

It realizes efficient and accurate detection of frame drop rate of screen project video, accurately evaluates image quality, and is suitable for different devices and wireless screen projection methods.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN116193189B_ABST
    Figure CN116193189B_ABST
Patent Text Reader

Abstract

The present invention discloses a method, device, system, electronic device and storage medium for testing the frame loss rate of a screen projection video, wherein the frame loss rate testing method comprises: obtaining a recorded video, wherein the screen projection video is a video in which the original video sent by the screen projection sending end is projected and played on the screen projection receiving end; parsing the recorded video to obtain a first picture set corresponding to the recorded video, wherein the first picture set includes multiple frames of first pictures; parsing the original video to obtain a second picture set corresponding to the original video, wherein the second picture set includes multiple frames of second pictures; comparing the first picture set and the second picture set, and determining the frame loss rate of the recorded video according to the comparison result. The present invention obtains a recorded video through a third-party device, wherein the recorded video can be equivalent to the screen projection video, and compares the first picture set corresponding to the recorded video and the second picture set corresponding to the original video to determine the frame loss rate of the recorded video, thereby efficiently and accurately detecting the frame loss rate of the screen projection video, and then accurately evaluating the image quality of the screen projection video.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of screen projection technology, and in particular to a method, device, system, electronic device and storage medium for testing the frame loss rate of a screen projection video. Background Art

[0002] Wireless screen projection refers to the technology that allows a smart mobile device client to display the screen image and sound of the local device on another display device via Wi-Fi (wireless communication technology), thereby achieving the same-screen display. With the support of the above wireless technology, how to test and evaluate the quality of the video image after projection in different scenarios and different connection methods, so as to ensure the user's screen projection experience, is a problem to be solved in the current screen projection technology field. Summary of the invention

[0003] The technical problem to be solved by the present invention is to overcome the defect in the prior art that the video quality after screen projection cannot be efficiently and accurately tested, and to provide a frame loss rate test method, device, system, electronic device and storage medium for screen projection video.

[0004] The present invention solves the above technical problems through the following technical solutions:

[0005] In a first aspect, the present invention provides a method for testing a frame loss rate of a screen projection video, the method comprising:

[0006] Obtain a recorded video obtained by recording the screen projection video, wherein the screen projection video is a video in which the original video sent by the screen projection sending end is projected and played on the screen projection receiving end;

[0007] Parsing the recorded video to obtain a first picture set corresponding to the recorded video, the first picture set including a plurality of first frames;

[0008] Parse the original video to obtain a second picture set corresponding to the original video, where the second picture set includes multiple frames of second pictures;

[0009] The first picture set and the second picture set are compared, and a frame loss rate of the recorded video is determined according to the comparison result.

[0010] Preferably, the recording frame rate of the recorded video is proportional to the playback frame rate of the original video.

[0011] Preferably, the step of comparing the first picture set and the second picture set and determining the frame loss rate of the recorded video according to the comparison result includes:

[0012] For each frame of the first picture in the first picture set, compare the similarity between the first picture and an adjacent second picture; the adjacent second picture is a picture whose playback time difference between the playback time of the second picture set and the projection playback time of the first picture is less than a difference threshold;

[0013] When the similarity is greater than or equal to a preset similarity, determining that the recorded video has no frame loss;

[0014] When the similarity is less than the preset similarity, determining that the recorded video has lost frames;

[0015] Count the number of frame drops and non-dropped frames;

[0016] The frame loss rate of the recorded video is determined according to the ratio of the frame loss number to the total number; the total number is the sum of the frame loss number and the non-frame loss number.

[0017] Preferably, the step of determining the frame loss rate of the recorded video according to the comparison result comprises:

[0018] generating a statistical report according to the frame loss rate;

[0019] The statistical report is sent to an external device.

[0020] Preferably, after determining the frame loss rate of the recorded video according to the comparison result, the method further includes:

[0021] Sending a screen projection mode switching instruction to the screen projection sending end and the screen projection receiving end to trigger the screen projection sending end and the screen projection receiving end to re-establish a connection according to the wireless screen projection mode carried by the screen projection mode switching instruction; wherein the wireless screen projection mode includes at least one of AirPlay, DLNA and Miracast;

[0022] After determining that the screen projection sending end and the screen projection receiving end have re-established a connection, return to the step of obtaining the recorded video.

[0023] Preferably, after determining the frame loss rate of the recorded video according to the comparison result, the method further includes:

[0024] Sending a video switching instruction to the screen projection sending end to trigger the screen projection sending end to sequentially switch original videos of different video format types for playback and send the switched original videos to the screen projection receiving end;

[0025] After determining that the screen projection sending end sends the switched original video to the screen projection receiving end, return to the step of obtaining the recorded video.

[0026] In a second aspect, the present invention provides a frame loss rate testing device for a screen projection video, the frame loss rate testing device for a screen projection video comprising:

[0027] An acquisition module is used to acquire a recorded video obtained by recording the screen projection video, wherein the screen projection video is a video in which the original video sent by the screen projection sending end is projected and played on the screen projection receiving end;

[0028] A parsing module, used to parse the recorded video to obtain a first picture set corresponding to the recorded video, the first picture set including multiple frames of first pictures; and also used to parse the original video to obtain a second picture set corresponding to the original video, the second picture set including multiple frames of second pictures;

[0029] A comparison module is used to compare the first picture set and the second picture set, and determine the frame loss rate of the recorded video according to the comparison result.

[0030] In a third aspect, the present invention provides a frame loss rate testing system for a projection video, the frame loss rate testing system for a projection video comprising a camera and a server, the server executing the above-mentioned frame loss rate testing method for a projection video; the camera is used to record the projection video to obtain a recorded video, and send the recorded video to the server.

[0031] In a fourth aspect, the present invention provides an electronic device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the above-mentioned frame loss rate test method for projection video when executing the computer program.

[0032] In a fifth aspect, the present invention provides a computer-readable storage medium having a computer program stored thereon, and when the computer program is executed by a processor, the above-mentioned frame loss rate testing method for the projection video is implemented.

[0033] The positive and progressive effects of the present invention are:

[0034] The present invention obtains a recorded video through a third-party device, and the recorded video can be equivalent to a projected screen video. The first picture set corresponding to the recorded video and the second picture set corresponding to the original video are compared to determine the frame loss rate of the recorded video, thereby efficiently and accurately detecting the frame loss rate of the projected screen video, and then accurately evaluating the picture quality of the projected screen video. BRIEF DESCRIPTION OF THE DRAWINGS

[0035] Figure 1 A flowchart of a method for testing the frame loss rate of a screen projection video provided in Embodiment 1 of the present invention;

[0036] Figure 2 for Figure 1 A flowchart of an implementation method for determining a frame loss rate by comparing similarities;

[0037] Figure 3A flowchart of an implementation method for generating and sending a statistical report of the screen projection video frame loss rate test method of embodiment 1 of the present invention;

[0038] Figure 4 A flowchart of an implementation method of different wireless screen projection methods for the screen projection video frame loss rate test method of embodiment 1 of the present invention;

[0039] Figure 5 A flowchart of an implementation method for different video formats of the method for testing the frame loss rate of a screen projection video according to Embodiment 1 of the present invention;

[0040] Figure 6 This is an interactive diagram of a specific example of a method for testing the frame loss rate of a screen projection video according to Embodiment 1 of the present invention;

[0041] Figure 7 A structural diagram of a device for testing the frame loss rate of a screen projection video provided in Embodiment 2 of the present invention;

[0042] Figure 8 This is a structural diagram of another device for testing the frame loss rate of screen projection video according to Embodiment 2 of the present invention;

[0043] Fig. 9 A structural diagram of a screen projection video frame loss rate testing system provided in Example 3 of the present invention;

[0044] Fig.10 This is an internal structure diagram of a specific example of a system for testing the frame loss rate of a screen projection video according to Embodiment 3 of the present invention;

[0045] Fig.11 A schematic diagram of the structure of an electronic device provided in Example 4 of the present invention. DETAILED DESCRIPTION

[0046] The present invention is further described below by way of examples, but the present invention is not limited to the scope of the examples.

[0047] Example 1

[0048] In practice, mobile terminals such as mobile phones and tablets can be connected to large-screen devices such as portable personal computers and TVs through wireless screen projection. The video after projection may have problems such as frame skipping, which affects the user's viewing experience. Therefore, testing and evaluating the picture quality of projection videos in different scenarios and different connection methods is conducive to counting the problems of projection technology, solving the problems in a targeted manner, and pointing out a clear path for product development.

[0049] Currently, only manual comparison can be used for projection videos, which not only has low test efficiency but also has a high error rate in the test results. The present embodiment provides a frame loss rate test method for projection videos, which not only efficiently and accurately tests the frame loss rate of projection videos, but also can be applied to different device types and different wireless projection methods, and can be generally applicable to the frame loss rate test process.

[0050] See also Figure 1 , the frame loss rate test method of screen projection video includes:

[0051] S1. Obtain a recorded video obtained by recording the screen projection video.

[0052] Among them, the screen projection video is a video that projects the original video sent by the screen projection sending end on the screen projection receiving end for playback. The screen projection sending device includes the screen projection sending end, and the screen projection sending device includes mobile terminal devices such as mobile phones and tablet computers.

[0053] In an optional implementation, the projection video is obtained according to a wireless projection method, and the wireless projection method includes at least one of an AirPlay projection method, a DLNA projection method, and a Miracast projection method.

[0054] The screen projection sending device sends the original video to the screen projection receiving end of the screen projection receiving device through wireless screen projection methods (such as AirPlay, DLNA, Miracast and other wireless screen projection methods). Screen projection receiving devices include laptops, TVs, monitors, and TV boxes.

[0055] The recorded video is recorded by a third-party recording device other than the screen projection sending device and the screen projection receiving device. For example: if the original video on the mobile phone (screen projection sending device) is projected to the TV (screen projection receiving device) through wireless screen projection, the screen projection video played on the TV screen can be recorded by a high-speed camera (third-party recording device). The video captured by the high-speed camera is the recorded video.

[0056] S2. parse the recorded video to obtain a first picture set corresponding to the recorded video.

[0057] The first picture set includes a plurality of first picture frames.

[0058] S3. Analyze the original video to obtain a second picture set corresponding to the original video.

[0059] The second picture set includes a plurality of second picture frames.

[0060] Among them, the original video is the video sent by the screen projection sender.

[0061] A video is composed of a plurality of static images, one static image being a frame. By analyzing each frame of a recorded video and an original video, a plurality of static images can be obtained. These static images constitute a first picture set and a second picture set.

[0062] S4: Compare the first picture set and the second picture set, and determine the frame loss rate of the recorded video according to the comparison result.

[0063] In this embodiment, a recorded video is obtained through a third-party device. The recorded video can be equivalent to the projected video. The first picture set corresponding to the recorded video and the second picture set corresponding to the original video are compared to determine the frame loss rate of the recorded video, thereby efficiently and accurately detecting the frame loss rate of the projected video, and then accurately evaluating the picture quality of the projected video.

[0064] In an optional implementation, the frame rate of the recorded video is proportional to the frame rate of the original video.

[0065] The video frame rate represents the number of video display frames per second, and the unit of video frame rate is fps. Because the human eye has the physiological phenomenon of visual retention, the higher the number of video display frames that can be updated within one second, the smoother and more realistic the animation can be. Generally speaking, if the video frame rate is greater than or equal to 30fps, a smooth video screen will be obtained. If the video frame rate is greater than or equal to 60fps, the interactive and realistic feeling of the video will be significantly improved. However, if the video frame rate exceeds 75fps, the smoothness of the video will not be significantly improved.

[0066] In order to facilitate the comparison of each frame of the recorded video and the original video, the frame rate of the recorded video and the frame rate of the original video are set to be proportional.

[0067] For example: If the frame rate of the recorded video and the frame rate of the original video are both 60fps, then 60 static images in the first picture set and 60 static images in the second picture set need to be compared within one second, that is, the number of static images that need to be compared at the original video playback time and the recorded video projection playback time is equal, and the time difference between the original video playback time and the recorded video projection playback time is less than the difference threshold.

[0068] For another example: if the frame rate of the recorded video is 30fps and the frame rate of the original video is 60fps, then it is necessary to compare the 30 static pictures in the first picture set and the 60 static pictures in the second picture set within one second, that is, at the time of the original video playback and the time of the recorded video projection playback, the ratio of the number of static pictures corresponding to the recorded video and the number of static pictures corresponding to the original video is one to two, and the time difference between the original video playback time and the recorded video projection playback time is less than the difference threshold.

[0069] Another example: if the frame rate of the recorded video is 60fps and the frame rate of the original video is 30fps, then the 60 static images in the first picture set and the 30 static images in the second picture set need to be compared within one second, that is, at the time of the original video playback and the time of the recorded video being cast and played, the ratio of the number of static images corresponding to the recorded video to the number of static images corresponding to the original video is two to one, and the time difference between the time of the original video playback and the time of the recorded video being cast and played is less than the difference threshold.

[0070] In this embodiment, the frame rate of the recorded video is proportional to the frame rate of the original video, which facilitates quantification of the number of static pictures corresponding to the recorded video and the original video, thereby improving the efficiency of detecting the frame loss rate of the projected video.

[0071] In an alternative embodiment, see Figure 2 , step S4 comprises:

[0072] S41 . For each first picture frame in the first picture set, compare the similarity between the first picture and an adjacent second picture.

[0073] The adjacent second picture is a picture whose time difference between the playback time of the second picture set and the projection playback time of the first picture is less than the difference threshold. The difference threshold is determined according to actual needs.

[0074] For example: If the difference threshold is 1 second, the first picture to be compared is a static picture at 3 minutes and 10 seconds during the screen projection playback of the recorded video, then the corresponding adjacent second picture is obtained between 3 minutes and 9 seconds and 3 minutes and 10 seconds during the playback time of the original video, and the similarity between the first picture and the adjacent second picture is compared.

[0075] S42: Determine the magnitude of the similarity and the preset similarity.

[0076] When the similarity is greater than or equal to the preset similarity, step S43 is executed, and when the similarity is less than the preset similarity, step S44 is executed.

[0077] The similarity of several static images can be calculated by using structural similarity measurement method, cosine similarity calculation method, histogram normalization method, hash algorithm and other calculation methods. The preset similarity can be set according to the needs.

[0078] S43: Determine that no frame is lost in the recorded video.

[0079] For example: If the preset similarity is 95%, when the similarity is greater than or equal to 95%, it means that the compared pictures show a very high similarity, and the two pictures can be determined to be consistent, that is, the projection video does not lose frames during the projection video playback process of the projection receiving device.

[0080] S44: Determine whether the recorded video has frame loss.

[0081] For example: if the preset similarity is 95%, when the similarity is less than 95%, it means that the compared pictures do not show high similarity, and the two pictures can be determined to be inconsistent, that is, there are frame drops in the projection video during the projection receiving device playing the projection video.

[0082] S45. Count the number of frame loss times and the number of frame non-loss times.

[0083] S46: Determine the frame loss rate of the recorded video according to the ratio of the number of frame loss times to the total number of frame loss times.

[0084] The total number is the sum of the number of frame loss and the number of frame non-loss.

[0085] In this embodiment, the similarity between the first picture and the second picture at the time of the original video playback and the time of the recorded video screen projection playback is used to determine whether the recorded video has frame loss, and the frame loss rate of the recorded video is determined based on the ratio of the number of frame loss times to the total number of times, thereby evaluating the image quality and smoothness of the recorded video and providing guidance for further product research and development.

[0086] In an alternative embodiment, see Figure 3 , after step S4, including:

[0087] S5. Generate a statistical report based on the frame loss rate.

[0088] S6. Send the statistical report to the external device.

[0089] External devices can be screen projection sending devices, screen projection receiving devices, cloud, etc.

[0090] In this embodiment, after receiving the statistical report, the external device sends the statistical report to the tester, so that the tester can quickly obtain the detection data of the projection video loss rate, improve the test efficiency, and reduce the error of manual video comparison.

[0091] In an optional implementation, the frame loss rate testing method for screen projection videos can test screen projection videos of different formats.

[0092] The testable projection video formats include different video resolutions, such as 480P, 720P, 1080P, Blu-ray, 2K, 4K and other video resolutions.

[0093] In this embodiment, the frame loss rate test method of the projection video can be applied to one or more projection video formats and has universal applicability.

[0094] In an alternative embodiment, see Figure 4 , after step S4, further comprising:

[0095] S7. Send a screen projection mode switching instruction to the screen projection sending end and the screen projection receiving end to trigger the screen projection sending end and the screen projection receiving end to re-establish the connection according to the wireless screen projection mode carried by the screen projection mode switching instruction.

[0096] Among them, the wireless screen projection method includes at least one of AirPlay, DLNA and Miracast.

[0097] After determining that the screen projection sending end and the screen projection receiving end have re-established the connection, return to step S1.

[0098] In this embodiment, the frame loss rate test method of the projection video can detect the projection video obtained through different wireless projection methods, and the application scenario types are diverse.

[0099] In an alternative embodiment, see Figure 5 , after step S4, further comprising:

[0100] S8. Send a video switching instruction to the screen projection sending end to trigger the screen projection sending end to switch the original videos of different video format types in turn for playback and send the switched original videos to the screen projection receiving end.

[0101] Different video format types include different video resolutions, including 480P, 720P, 1080P, Blu-ray, 2K, 4K and other video resolutions.

[0102] After it is determined that the screen projection sending end sends the switched original video to the screen projection receiving end, return to step S1.

[0103] In this embodiment, the frame loss rate test method of the projected video can detect the projected video after the original video is projected according to different video formats, and the video format of the projected video can be switched at the same time. The detected projected video is not limited to a single video format and is applicable to a wide range of scenarios.

[0104] A frame rate testing method is introduced below to specifically describe the frame loss rate testing method of the screen projection video of this embodiment.

[0105] See also Figure 6 The frame rate test interactive diagram, the specific steps are:

[0106] Step 1: Set up the test environment according to the requirements, and debug the test equipment such as the wireless access point (AP), the device under test (i.e. the screen projection sending device, DUT in this specific example) and the screen receiver (i.e. the screen projection receiving device).

[0107] For example: the tester reads the cloud test cases and wireless access point setting requirements through the PC (that is, runs the test and reads the cloud test requirements), configures the wireless mode, channel bandwidth, encryption method and password of the wireless access point; initializes the device under test, installs the application required for playing the video, and loads videos of different frame rates and formats into the device under test; the screen receiver is turned on and off by a wireless remote control and kept on; the DUT (device under test) and wireless access point (AP) WiFi signal (wireless communication signal) are automatically connected, and the wireless access point (AP) and the screen receiver are connected by wire; the screen projection connection between the DUT (device under test) and the screen receiver is realized by any wireless projection method such as AirPlay, DLNA, and Miracast.

[0108] In a wireless network, a wireless access point is equivalent to a hub in a wired network, which can connect various wireless clients. In this specific example, the wireless access point connects the device to be tested and the image receiver.

[0109] The tester receives the signals transmitted by the image receiver, high-speed camera, and device under test through the PC (personal computer), and processes the signals to control the frame rate test process. The PC, image receiver, and wireless access point are connected through a network cable; the device under test, high-speed camera, and PC are connected through a USB (universal serial bus) cable.

[0110] Step 2: The tester sends the test task to the PC in the cloud. The PC uses an automated script to simultaneously control the wireless access point (AP), high-speed camera, device under test, and image receiver to perform the test task.

[0111] Step 3: Play the video or browse the screen on the DUT (device under test) side. At this time, the screen receiver displays the received video or screen. At the same time, the PC controls the high-speed camera to record the screen receiver until the video playback or screen browsing is completed.

[0112] Step 4: Upload the video recorded by the high-speed camera (i.e., the recorded video) to the automatic statistical system (on the PC side, i.e., the high-speed camera transmits the recorded video data to the PC side). And use the parsing module to automatically parse the recorded video screen and the original video screen into frame pictures (i.e., the first picture set and the second picture set).

[0113] Step 5: Use a comparison module to compare the frame images of the recorded video with the frame images of the original video for similarity, and count the total frame loss rate.

[0114] Step 6: Generate test results (i.e., statistical reports) based on the final statistical results, and store the test results in the cloud (external device). When all tests are completed, the cloud will count all test contents and test results, and send the test results to the tester.

[0115] Example 2

[0116] This embodiment provides a device for testing the frame loss rate of screen projection video. Figure 7 , the frame loss rate test device of the screen projection video includes:

[0117] The acquisition module 1 is used to obtain the recorded video obtained by recording the screen projection video.

[0118] Among them, the screen projection video is a video that projects the original video sent by the screen projection sending end on the screen projection receiving end for playback. The screen projection sending device includes the screen projection sending end, and the screen projection sending device includes mobile terminal devices such as mobile phones and tablet computers.

[0119] In an optional implementation, the projection video is obtained according to a wireless projection method, and the wireless projection method includes at least one of an AirPlay projection method, a DLNA projection method, and a Miracast projection method.

[0120] The screen projection sending device sends the original video to the screen projection receiving end of the screen projection receiving device through wireless screen projection methods (such as AirPlay, DLNA, Miracast and other wireless screen projection methods). Screen projection receiving devices include laptops, TVs, monitors, and TV boxes.

[0121] The recorded video is recorded by a third-party recording device other than the screen projection sending device and the screen projection receiving device. For example: if the original video on the mobile phone (screen projection sending device) is projected to the TV (screen projection receiving device) through wireless screen projection, the screen projection video played on the TV screen can be recorded by a high-speed camera (third-party recording device). The video captured by the high-speed camera is the recorded video.

[0122] The parsing module 2 is used to parse the recorded video to obtain a first picture set corresponding to the recorded video; and is also used to parse the original video to obtain a second picture set corresponding to the original video.

[0123] Among them, the first picture set includes multiple frames of first pictures, the second picture set includes multiple frames of second pictures, and the original video is the video sent by the screen projection sender.

[0124] A video is composed of a plurality of static images, one static image being a frame. By analyzing each frame of a recorded video and an original video, a plurality of static images can be obtained. These static images constitute a first picture set and a second picture set.

[0125] The comparison module 3 is used to compare the first picture set and the second picture set, and determine the frame loss rate of the recorded video according to the comparison result.

[0126] In this embodiment, the frame loss rate test system of the projected video obtains a recorded video through a third-party device. The recorded video can be equivalent to the projected video. The first picture set corresponding to the recorded video and the second picture set corresponding to the original video are compared to determine the frame loss rate of the recorded video, thereby efficiently and accurately detecting the frame loss rate of the projected video, and then accurately evaluating the picture quality of the projected video.

[0127] In an alternative embodiment, see Figure 8 The frame loss rate test system of the screen projection video also includes a setting module 4, which is used to set the frame rate of the recorded video and the frame rate of the original video. The frame rate of the recorded video and the frame rate of the original video are in proportional relationship.

[0128] In this embodiment, the frame rate of the recorded video in the frame loss rate test system of the projected video is proportional to the frame rate of the original video, which is convenient for quantifying the number of static pictures corresponding to the recorded video and the original video, thereby improving the efficiency of detecting the frame loss rate of the projected video.

[0129] In an optional implementation, the comparison module 3 is further configured to compare the similarity between each frame of the first picture in the first picture set and an adjacent second picture.

[0130] The adjacent second picture is a picture whose time difference between the playback time of the second picture set and the projection playback time of the first picture is less than the difference threshold. The difference threshold is determined according to actual needs.

[0131] See also Figure 8 , the frame loss rate test system of screen projection video also includes:

[0132] The judging module 5 is used to judge the size of the similarity and the preset similarity.

[0133] The similarity of several static images can be calculated by using structural similarity measurement method, cosine similarity calculation method, histogram normalization method, hash algorithm and other calculation methods. The preset similarity can be set according to the needs.

[0134] The determination module 6 is used to determine that the recorded video has no frame loss when the similarity is greater than or equal to the preset similarity; and is also used to determine that the recorded video has frame loss when the similarity is less than the preset similarity.

[0135] The statistics module 7 is used to count the number of frame loss and the number of non-frame loss.

[0136] The determination module 6 is further used to determine the frame loss rate of the recorded video according to the ratio of the number of frame losses to the total number of frame losses.

[0137] The total number is the sum of the number of frame loss and the number of frame non-loss.

[0138] In this embodiment, the frame loss rate test system of the projected video determines whether the recorded video has frame loss through the similarity between the first picture and the second picture at the original video playback time and the recorded video projection playback time, and determines the frame loss rate of the recorded video according to the ratio of the number of frame losses to the total number of frame losses, thereby evaluating the image quality and smoothness of the recorded video and providing direction for further product research and development.

[0139] In an alternative embodiment, see Figure 8 , the frame loss rate test system of screen projection video also includes:

[0140] The generating module 8 is used to generate a statistical report according to the frame loss rate.

[0141] The sending module 9 is used to send the statistical report to an external device.

[0142] External devices can be screen projection sending devices, screen projection receiving devices, cloud, etc.

[0143] In this embodiment, after receiving the statistical report, the external device sends the statistical report to the tester, so that the tester can quickly obtain the detection data of the projection video loss rate, improve the test efficiency, and reduce the error of manual video comparison.

[0144] In an optional embodiment, the frame loss rate test system of the screen projection video can be applied to test screen projection videos of different formats.

[0145] The testable projection video formats include different video resolutions, such as 480P, 720P, 1080P, Blu-ray, 2K, 4K and other video resolutions.

[0146] In this embodiment, the frame loss rate test system of the projection video can be applied to one or more projection video formats and has universal applicability.

[0147] In an optional embodiment, the sending module 9 is also used to send a screen projection mode switching instruction to the screen projection sending end and the screen projection receiving end to trigger the screen projection sending end and the screen projection receiving end to re-establish the connection according to the wireless screen projection mode carried by the screen projection mode switching instruction.

[0148] Among them, the wireless screen projection method includes at least one of AirPlay, DLNA and Miracast.

[0149] After determining that the screen projection sending end and the screen projection receiving end have re-established the connection, return to the acquisition module 1 to obtain the recorded video obtained by recording the screen projection video.

[0150] In this embodiment, the frame loss rate test system of the projection video can detect the projection video obtained through different wireless projection methods, and the application scenario types are diverse.

[0151] In an optional embodiment, the sending module 9 is also used to send a video switching instruction to the screen projection sending end to trigger the screen projection sending end to switch the original video of different video format types in turn for playback and send the switched original video to the screen projection receiving end.

[0152] Different video format types include different video resolutions, including 480P, 720P, 1080P, Blu-ray, 2K, 4K and other video resolutions.

[0153] After determining that the screen projection sending end sends the switched original video to the screen projection receiving end, return to the acquisition module 1 to obtain the recorded video obtained by recording the screen projection video.

[0154] In this embodiment, the frame loss rate test system of the projected video can detect the projected video after the original video is projected according to different video formats, and can switch the video format of the projected video at the same time. The detected projected video is not limited to a single video format and has a wide range of applicable scenarios.

[0155] Example 3

[0156] This embodiment provides a system for testing the frame loss rate of screen projection video. Fig. 9 The frame loss rate test system of the projection video includes a camera 91 and a server 92. The server 92 executes the frame loss rate test method of the projection video in Example 1. The camera 91 is used to record the projection video to obtain a recorded video, and send the recorded video to the server 92.

[0157] Fig.10 It is a schematic diagram of the internal equipment structure of a specific frame loss rate test system for screen projection video, wherein the picture receiver, the device to be tested, the wireless AP (wireless access point), the cloud and the PC (personal computer) are the hardware devices of the server 92, the picture receiver is the screen projection receiving device, the device to be tested is the screen projection sending device, the camera 91 is a third-party recording device, and the wireless AP is a wireless access point, which can connect various wireless clients. In this specific example, the wireless AP connects the device to be tested and the picture receiver through a WiFi signal (i.e., a wireless communication signal). The tester receives the signals transmitted by the picture receiver, the camera 91, the device to be tested, etc. through the PC, and processes the signals to control the frame rate test process. The PC transmits the final test results to the cloud, and the tester sends the test task through the cloud and receives the test results.

[0158] Example 4

[0159] This embodiment provides an electronic device, Fig.11 The electronic device includes a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the program, the method for testing the frame loss rate of the screen projection video of Example 1 is implemented. Fig.11 The electronic device 30 shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present invention.

[0160] like Fig.11 As shown, the electronic device 30 may be in the form of a general-purpose computing device, for example, it may be a server device. The components of the electronic device 30 may include, but are not limited to: at least one processor 31, at least one memory 32, and a bus 33 connecting different system components (including the memory 32 and the processor 31).

[0161] The bus 33 includes a data bus, an address bus, and a control bus.

[0162] The memory 32 may include a volatile memory, such as a random access memory (RAM) 321 and / or a cache memory 322 , and may further include a read-only memory (ROM) 323 .

[0163] The memory 32 may also include a program / utility 325 having a set (at least one) of program modules 324, such program modules 324 including but not limited to: an operating system, one or more application programs, other program modules, and program data, each of which or some combination may include an implementation of a network environment.

[0164] The processor 31 executes various functional applications and data processing by running the computer program stored in the memory 32, such as the frame loss rate testing method of the screen projection video in Example 1 of the present invention.

[0165] The electronic device 30 may also communicate with one or more external devices 34 (e.g., keyboards, pointing devices, etc.). Such communication may be performed via an input / output (I / O) interface 35. Furthermore, the model generating device 30 may also communicate with one or more networks (e.g., a local area network (LAN), a wide area network (WAN), and / or a public network, such as the Internet) via a network adapter 36. Fig.11 As shown, the network adapter 36 communicates with other modules of the model-generated device 30 via the bus 33. It should be understood that, although not shown in the figure, other hardware and / or software modules can be used in conjunction with the model-generated device 30, including but not limited to: microcode, device drivers, redundant processors, external disk drive arrays, RAID (disk array) systems, tape drives, and data backup storage systems, etc.

[0166] It should be noted that although several units / modules or sub-units / modules of the electronic device are mentioned in the above detailed description, this division is merely exemplary and not mandatory. In fact, according to an embodiment of the present invention, the features and functions of two or more units / modules described above can be embodied in one unit / module. Conversely, the features and functions of one unit / module described above can be further divided into multiple units / modules to be embodied.

[0167] Example 5

[0168] This embodiment provides a computer-readable storage medium on which a computer program is stored. When the program is executed by a processor, the frame loss rate testing method of the projection video of Embodiment 1 is implemented.

[0169] The readable storage medium may include but is not limited to: a portable disk, a hard disk, a random access memory, a read-only memory, an erasable programmable read-only memory, an optical storage device, a magnetic storage device or any suitable combination of the above.

[0170] In a possible implementation manner, the present invention can also be implemented in the form of a program product, which includes a program code. When the program product runs on a terminal device, the program code is used to enable the terminal device to execute the frame loss rate test method for the screen projection video implemented in Example 1.

[0171] Among them, the program code for executing the present invention can be written in any combination of one or more programming languages, and the program code can be executed completely on the user device, partially on the user device, as an independent software package, partially on the user device and partially on a remote device, or completely on the remote device.

[0172] Although the specific embodiments of the present invention are described above, it should be understood by those skilled in the art that this is only for illustration and the protection scope of the present invention is defined by the appended claims. Those skilled in the art may make various changes or modifications to these embodiments without departing from the principles and essence of the present invention, but these changes and modifications all fall within the protection scope of the present invention.

Claims

1. A method for testing the frame loss rate of screen projection video. It is characterized in that The frame loss rate test method of the screen projection video includes: Obtain a recorded video obtained by recording the screen projection video, wherein the screen projection video is a video in which the original video sent by the screen projection sending end is projected and played on the screen projection receiving end; Parsing the recorded video to obtain a first picture set corresponding to the recorded video, the first picture set including a plurality of first frames; Parse the original video to obtain a second picture set corresponding to the original video, where the second picture set includes multiple frames of second pictures; comparing the first picture set and the second picture set, and determining a frame loss rate of the recorded video according to a comparison result; The step of comparing the first picture set and the second picture set and determining the frame loss rate of the recorded video according to the comparison result includes: For each frame of the first picture in the first picture set, compare the similarity between the first picture and an adjacent second picture; the adjacent second picture is a picture whose playback time difference between the playback time of the second picture set and the projection playback time of the first picture is less than a difference threshold; When the similarity is greater than or equal to a preset similarity, determining that the recorded video has no frame loss; When the similarity is less than the preset similarity, determining that the recorded video has lost frames; Count the number of frame drops and non-dropped frames; Determine the frame loss rate of the recorded video according to the ratio of the frame loss number to the total number; the total number is the sum of the frame loss number and the non-frame loss number; After determining the frame loss rate of the recorded video according to the comparison result, the method further includes: Sending a screen projection mode switching instruction to the screen projection sending end and the screen projection receiving end to trigger the screen projection sending end and the screen projection receiving end to re-establish a connection according to the wireless screen projection mode carried by the screen projection mode switching instruction; wherein the wireless screen projection mode includes at least one of AirPlay, DLNA and Miracast; when it is determined that the screen projection sending end and the screen projection receiving end have re-established a connection, returning to the step of obtaining the recorded video; and / or, Send a video switching instruction to the screen projection sending end to trigger the screen projection sending end to switch the original videos of different video format types in sequence for playback and send the switched original videos to the screen projection receiving end; after determining that the screen projection sending end sends the switched original video to the screen projection receiving end, return to the step of obtaining the recorded video.

2. The method for testing the frame loss rate of screen projection video according to claim 1, It is characterized in that The recording frame rate of the recorded video is proportional to the playback frame rate of the original video.

3. The method for testing the frame loss rate of a screen projection video according to any one of claims 1 to 2, It is characterized in that The step of determining the frame loss rate of the recorded video according to the comparison result includes: generating a statistical report according to the frame loss rate; The statistical report is sent to an external device.

4. A device for testing the frame loss rate of screen projection video. It is characterized in that The frame loss rate testing device of the screen projection video includes: An acquisition module is used to acquire a recorded video obtained by recording the screen projection video, wherein the screen projection video is a video in which the original video sent by the screen projection sending end is projected and played on the screen projection receiving end; A parsing module, used to parse the recorded video to obtain a first picture set corresponding to the recorded video, the first picture set including multiple frames of first pictures; and also used to parse the original video to obtain a second picture set corresponding to the original video, the second picture set including multiple frames of second pictures; A comparison module, used for comparing the first picture set and the second picture set, and determining a frame loss rate of the recorded video according to a comparison result; The comparison module is further used to compare the similarity between each frame of the first picture in the first picture set and an adjacent second picture; the adjacent second picture is a picture whose playback time difference between the playback time of the second picture set and the projection playback time of the first picture is less than a difference threshold; A determination module, configured to determine that the recorded video has no frame loss when the similarity is greater than or equal to a preset similarity; and determine that the recorded video has frame loss when the similarity is less than the preset similarity; Statistics module, used to count the number of frame loss and non-frame loss; The determination module is further used to determine the frame loss rate of the recorded video according to the ratio of the frame loss number to the total number; the total number is the sum of the frame loss number and the non-frame loss number; A sending module, used for sending a screen projection mode switching instruction to the screen projection sending end and the screen projection receiving end, so as to trigger the screen projection sending end and the screen projection receiving end to re-establish a connection according to the wireless screen projection mode carried by the screen projection mode switching instruction; wherein the wireless screen projection mode includes at least one of AirPlay, DLNA and Miracast; when it is determined that the screen projection sending end and the screen projection receiving end have re-established a connection, returning to the acquisition module to acquire the recorded video obtained by recording the screen projection video; and / or, The sending module is used to send a video switching instruction to the screen projection sending end to trigger the screen projection sending end to switch the original videos of different video format types in turn for playback and send the switched original videos to the screen projection receiving end; after determining that the screen projection sending end sends the switched original video to the screen projection receiving end, return to the acquisition module to obtain the recorded video obtained by recording the screen projection video.

5. A frame loss rate test system for screen projection video, It is characterized in that The frame loss rate test system for the projection video includes a camera and a server, and the server executes the frame loss rate test method for the projection video described in any one of claims 1-3; the camera is used to record the projection video to obtain a recorded video, and send the recorded video to the server.

6. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, It is characterized in that When the processor executes the computer program, the frame loss rate testing method of the screen projection video described in any one of claims 1-3 is implemented.

7. A computer-readable storage medium having a computer program stored thereon, It is characterized in that When the computer program is executed by a processor, the frame loss rate testing method of the screen projection video described in any one of claims 1-3 is implemented.

Citation Information

Patent Citations

  • Video display method and system

    CN101345892A

  • Content adaptive transform coding for next generation video

    CN104704827A

  • Method for switching subway train media playing mode

    CN104717535A

  • Code rate control method and device

    CN105323592A

  • Boosting based cost sensitive software defect prediction method

    CN106203534A