A visual internet data transmission link quality loss monitoring method, device and system

Abstract

The application relates to the technical field of video networking and discloses a video networking data transmission link quality loss monitoring method, device and system. A monitoring terminal sends a detection instruction to a to-be-tested video networking terminal, the monitoring terminal receives a test video file fed back by each link node of the video networking terminal and a data transmission link corresponding to the video networking terminal, calculates a quality measurement value of each frame of image in a video of the corresponding link node according to the received test video file, calculates a video quality comprehensive evaluation score value of the corresponding link node according to the quality measurement value, and then takes a difference value of the video quality comprehensive evaluation score values between the link nodes as a transmission loss value between the corresponding link nodes, wherein the test video file is obtained according to video stream data obtained by the node and the detection instruction with the current node identifier added. The application realizes monitoring of the data transmission link quality loss of the video networking, and can provide reliable and intuitive reference basis for performance optimization of the video networking link.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of video internet, and particularly relates to a video internet data transmission link quality loss monitoring method, device and system. BACKGROUND

[0002] In the video internet, there are many link nodes and distribution areas in large-scale networking. In the process of video stream data transmission between the link nodes, the transmitted video stream data has a certain loss due to the network and transmission distance of the transmission medium.

[0003] At present, the detection of the video stream data transmission link mainly detects the network connectivity between the link nodes. The quality detection of the transmitted data stream lacks detection means, and only the network connectivity can be detected, and the loss value of the video stream data in the transmission process cannot be confirmed. SUMMARY

[0004] The present application provides a video internet data transmission link quality loss monitoring method, device and system, which solves the technical problem of how to monitor the data transmission link quality loss of the video internet.

[0005] The method comprises:

[0006] generating a corresponding detection instruction according to the monitoring task configuration information, and sending the detection instruction to the corresponding video internet terminal to be tested;

[0007] receiving a test video file generated by the video internet terminal according to the detection instruction; the test video file of the video internet terminal comprises video stream data collected according to the detection instruction and an update instruction obtained by appending the identifier of the video internet terminal in the detection instruction;

[0008] receiving the test video file sent by each link node of the data transmission link corresponding to the video internet terminal; the test video file sent by the link node is generated when the link node receives the video stream data with the detection instruction sent by the previous node; the test video file sent by the link node comprises an update instruction obtained by appending the identifier of the current link node in the received detection instruction and the received video stream data;

[0009] calculating the quality measurement value of each frame of image in the video of the corresponding link node according to the received test video file, and calculating the video quality comprehensive evaluation score value of the corresponding link node according to the obtained quality measurement value;

[0010] calculating the difference value of the video quality comprehensive evaluation score value between the link nodes as the transmission loss value between the corresponding link nodes.

[0011] According to an implementable manner of the first aspect of the application, the calculation of the quality metric value of each frame image in the video of the corresponding link node according to the received test video file comprises:

[0012] The peak signal-to-noise ratio and the multi-scale structural similarity of each frame image in the video of the corresponding link node are calculated.

[0013] The quality metric value of the corresponding frame image is obtained by weighting the calculated values of the peak signal-to-noise ratio and the multi-scale structural similarity.

[0014] According to an implementable manner of the first aspect of the application, the calculation of the comprehensive evaluation score of the video quality of the corresponding link node according to the obtained quality metric value comprises:

[0015] The quality metric values of the frame images in the video of the link node are averaged to obtain the comprehensive evaluation score of the video quality of the corresponding link node.

[0016] The second aspect of the application provides a Web real-time communication data transmission link quality loss monitoring device, which comprises:

[0017] A sending module is configured to generate a corresponding detection instruction according to the monitoring task configuration information and send the detection instruction to the Web real-time communication terminal to be tested.

[0018] A first receiving module is configured to receive a test video file generated by the Web real-time communication terminal according to the detection instruction; the test video file of the Web real-time communication terminal comprises video stream data collected according to the detection instruction and an update instruction obtained by appending the identifier of the Web real-time communication terminal in the detection instruction.

[0019] A second receiving module is configured to receive test video files sent by each link node of the data transmission link corresponding to the Web real-time communication terminal; the test video file sent by the link node is generated when the link node receives the video stream data with the detection instruction sent by the previous node; the test video file sent by the link node comprises an update instruction obtained by appending the identifier of the current link node in the received detection instruction and the received video stream data.

[0020] A first calculation module is configured to calculate the quality metric value of each frame image in the video of the corresponding link node according to the received test video file and calculate the comprehensive evaluation score of the video quality of the corresponding link node according to the obtained quality metric value.

[0021] A second calculation module is configured to calculate the difference value of the comprehensive evaluation scores of the video quality between the link nodes and use the difference value as the transmission loss value between the corresponding link nodes.

[0022] According to an implementable manner of the second aspect of the present application, the first calculation module comprises:

[0023] a first calculation unit configured to calculate the peak signal-to-noise ratio and the multi-scale structural similarity of each frame image in the video of the corresponding link node;

[0024] a second calculation unit configured to obtain the quality measurement value of the corresponding frame image by weighting the calculated peak signal-to-noise ratio and multi-scale structural similarity values.

[0025] According to an implementable manner of the second aspect of the present application, the second calculation module comprises:

[0026] a third calculation unit configured to average the quality measurement values of the frame images in the video of the corresponding link node to obtain the video quality comprehensive evaluation score value of the corresponding link node.

[0027] The third aspect of the present application provides a videoconferencing data transmission link quality loss monitoring system, comprising a monitoring platform, a videoconferencing terminal and each link node of the data transmission link corresponding to the videoconferencing terminal.

[0028] The monitoring platform is configured to generate a corresponding detection instruction according to the monitoring task configuration information, and send the detection instruction to the corresponding videoconferencing terminal to be tested.

[0029] The videoconferencing terminal is configured to, when receiving the detection instruction, collect corresponding video stream data according to the detection instruction, attach the self-identity in the detection instruction to update the detection instruction, generate a test video file according to the current detection instruction and the collected video stream data and feed back to the monitoring platform, and send the collected video stream data with the current detection instruction to the next link node.

[0030] The link node is configured to, when monitoring the video stream data with the detection instruction, attach the self-identity in the received detection instruction to update the detection instruction, generate a test video file according to the current detection instruction and the received video stream data and feed back to the monitoring platform, and when the current link node is not the link terminal, the link node is further configured to send the received video stream data with the current detection instruction to the next link node.

[0031] The monitoring platform is further configured to calculate the quality measurement value of each frame image in the video of the corresponding link node according to the received test video file, calculate the video quality comprehensive evaluation score value of the corresponding link node according to the obtained quality measurement value, and calculate the difference value of the video quality comprehensive evaluation score values between the link nodes as the transmission loss value between the corresponding link nodes.

[0032] According to an implementable manner of the third aspect of the present application, the monitoring platform is specifically configured to:

[0033] a peak signal-to-noise ratio and a multi-scale structural similarity of each frame image in the corresponding link node video are calculated;

[0034] a quality measurement value of the corresponding frame image is obtained by weighting the calculated peak signal-to-noise ratio and multi-scale structural similarity values.

[0035] According to an implementable manner of the third aspect of the present application, the monitoring platform is further specifically configured to:

[0036] a video quality comprehensive evaluation score value of the corresponding link node is obtained by averaging the quality measurement values of the frame images in the link node video.

[0037] The fourth aspect of the present application provides a detection device, comprising:

[0038] a memory configured to store instructions; wherein the instructions are configured to implement the Web Real-Time Communication data transmission link quality loss monitoring method according to any one of the implementable manners described above;

[0039] a processor configured to execute the instructions in the memory.

[0040] The fifth aspect of the present application is a computer readable storage medium, and the computer readable storage medium stores a computer program, and the computer program is executed by a processor to implement the Web Real-Time Communication data transmission link quality loss monitoring method according to any one of the implementable manners described above.

[0041] As can be seen from the above technical solutions, the present application has the following advantages:

[0042] According to the present application, the monitoring terminal sends a detection instruction to the Web Real-Time Communication terminal to be tested, receives a test video file fed back by the Web Real-Time Communication terminal and each link node of the data transmission link corresponding to the Web Real-Time Communication terminal, calculates a quality measurement value of each frame image in the video of the corresponding link node according to the received test video file, calculates a video quality comprehensive evaluation score value of the corresponding link node according to the obtained quality measurement value, and further takes the difference between the video quality comprehensive evaluation score values of the link nodes as the transmission loss value between the corresponding link nodes, wherein the test video file is obtained according to the video stream data obtained by the node and the detection instruction with the current node identifier added. According to the objective video quality evaluation score value, the present application judges the transmission loss result of each node, realizes the monitoring of the data transmission link quality loss of the Web Real-Time Communication, and the evaluation result is more in line with the actual user's sensory experience. Through the scheme of the present application, the transmission efficiency and data loss of the Web Real-Time Communication terminal equipment in different links in each region can be tracked in real time, and reliable and intuitive reference basis can be provided for the performance optimization of the Web Real-Time Communication link. BRIEF DESCRIPTION OF DRAWINGS

[0043] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the drawings needed to be used in the embodiments or prior art description. Obviously, the drawings described below are only some embodiments of the present application, and for those skilled in the art, other drawings can also be obtained from these drawings without creative labor.

[0044] Figure 1 A flow chart of a visual networking data transmission link quality loss monitoring method provided for an optional embodiment of the present application is shown in the figure.

[0045] Figure 2 A structural connection schematic diagram of a visual networking data transmission link quality loss monitoring device provided for an optional embodiment of the present application is shown in the figure.

[0046] Figure 3 A structural schematic diagram of a visual networking data transmission link quality loss monitoring system provided for an optional embodiment of the present application is shown in the figure.

[0047] Reference signs:

[0048] Figure 2 In the figure, 1 is a sending module; 2 is a first receiving module; 3 is a second receiving module; 4 is a first calculation module; 5 is a second calculation module.

[0049] Figure 3 In the figure, 10 is a monitoring platform; 20 is a visual networking terminal; 30 is a link node; 100 is a monitoring task module; 200 is an instruction scheduling module; 300 is a video quality evaluation module; 400 is a data acquisition module; 500 is an instruction processing module. DETAILED DESCRIPTION

[0050] The embodiments of the present application provide a visual networking data transmission link quality loss monitoring method, device and system, which are used to solve the technical problem of how to monitor the data transmission link quality loss of visual networking.

[0051] In order to make the purposes, features and advantages of the present application more obvious and easy to understand, the technical solutions in the embodiments of the present application will be described clearly and completely in combination with the drawings in the embodiments of the present application. Obviously, the embodiments described below are only some of the embodiments of the present application, but not all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative labor are within the scope of protection of the present application.

[0052] The present application provides a visual networking data transmission link quality loss monitoring method.

[0053] Please refer to Figure 1 ,Figure 1 A flow chart of a method for monitoring quality loss of a data transmission link of a vision network according to an embodiment of the present application is shown.

[0054] A method for monitoring quality loss of a data transmission link of a vision network according to an embodiment of the present application comprises steps S1-S5.

[0055] In step S1, a detection instruction is generated according to monitoring task configuration information, and the detection instruction is sent to a vision network terminal to be tested.

[0056] The monitoring task configuration information can be pre-stored information, so that the detection instruction can be generated according to a preset time point. The monitoring task configuration information can also be information sent by a preset terminal, and the detection instruction can be generated upon receiving the monitoring task configuration information. The monitoring task configuration information can include a size threshold of video stream data to be collected and an identifier of the vision network terminal to be tested.

[0057] In step S2, a test video file generated by the vision network terminal according to the detection instruction is received. The test video file of the vision network terminal includes video stream data collected according to the detection instruction and an updated instruction obtained by appending the identifier of the vision network terminal to the detection instruction.

[0058] The vision network terminal appends its own identifier to the detection instruction after receiving the detection instruction, thereby obtaining the updated instruction. Specifically, the vision network terminal appends the identifier of the vision network terminal to the link node information field of the detection instruction.

[0059] As an implementable manner, the detection instruction includes a size threshold of video stream data to be collected, so that the vision network terminal collects video stream data consistent with the size threshold according to the detection instruction.

[0060] When generating the test video file, specifically, the vision network terminal can copy the received video stream data twice, package one part of the video stream data and the updated detection instruction as the test video file for video quality evaluation, and send the other part of the video stream data with the updated detection instruction to the next link node of data transmission.

[0061] In step S3, test video files sent by each link node of a data transmission link corresponding to the vision network terminal are received. The test video file sent by the link node is generated when the link node receives video stream data with a detection instruction sent by a previous node, and the test video file sent by the link node includes an updated instruction obtained by appending an identifier of the current link node to the received detection instruction and the received video stream data.

[0062] Wherein, when the link node monitors the video stream data with the detection instruction, the detection instruction is updated, the current node unique identifier is attached to the link node information, and the video stream data is packaged into a test video file together.

[0063] Wherein, if the current link node is not the end of the link, when generating the test video file, specifically, the current link node can copy the monitored video stream data twice, package one video stream data and the updated detection instruction as the test video file for video quality evaluation, and send the other video stream data with the updated detection instruction to the next link node of data transmission; if the current link node is the end of the link, the current link node no longer sends the video stream data with the detection instruction.

[0064] Wherein, whether the node is the end of the link can be determined by the unique identifier of the current node.

[0065] Through step S3, the test video file sent by all link nodes of the data transmission link corresponding to the video over internet terminal can be obtained, so as to facilitate the analysis of the quality loss between links in the future.

[0066] Step S4, according to the received test video file, the quality metric value of each frame image in the video of the corresponding link node is calculated, and the video quality comprehensive evaluation score value of the corresponding link node is calculated according to the obtained quality metric value.

[0067] One or more of gradient similarity (GSIM), feature similarity with color information (FSIMC), gradient magnitude similarity deviation (GMSD), gradient similarity measure (IGM), visual information fidelity (VIF), peak signal-to-noise ratio (PSNR) and multi-scale structural similarity (MS-SSIM) can be selected as the quality metric of the image.

[0068] As an implementable way, the peak signal-to-noise ratio and multi-scale structural similarity of the image are used to calculate the quality metric value. Specifically, when calculating the quality metric value, first, the peak signal-to-noise ratio and multi-scale structural similarity of each frame image in the video of the corresponding link node are calculated; then, the peak signal-to-noise ratio and multi-scale structural similarity values calculated are weighted to obtain the quality metric value of the corresponding frame image.

[0069] As a specific implementation, the calculation formula of the quality metric value is:

[0070]

[0071] In the formula, S n represents the quality metric value of the nth frame image, P nPSNR index score of the nth frame image, M n MS-SSIM index score of the nth frame image, a and b respectively represent the weight ratio of PSNR and MS-SSIM index, a+b=1.

[0072] The specific value of the weight ratio of PSNR and MS-SSIM index can be adjusted according to actual needs.

[0073] The specific calculation formula of the PSNR index score is:

[0074]

[0075] In the formula, n is the number of bits per pixel, MSE represents the mean square error of the current image X and the reference image Y, H and W respectively represent the height and width of the image, X(i,j) is the pixel value of the pixel point (i,j) of the current image, and Y(i,j) is the pixel value of the pixel point (i,j) of the reference image.

[0076] The calculation formula of the MS-SSIM index score formula is:

[0077]

[0078] In the formula, M represents different scales, μ p and μ g respectively represent the mean of the predicted image and the ground truth (real image), σ p and σ g respectively represent the standard deviation of the predicted image and the ground truth, σ pg represents the covariance between the predicted value and the ground truth, β m and γ m respectively represent the relative importance between the mean and the standard deviation, and c1 and c2 are constant terms.

[0079] PSNR is the most common and widely used image objective evaluation index, which is based on the error between corresponding pixel points, that is, error-sensitive image quality evaluation. Since the human eye visual characteristics (the human eye has high sensitivity to the contrast difference of low spatial frequency, the human eye has higher sensitivity to the contrast difference of brightness than chroma, the human eye's perception of a region is affected by its surrounding areas, etc.) are not considered, the evaluation result is not completely consistent with the visual quality seen by the human eye. And MS-SSIM integrates image details and is suitable for applications under different resolutions. In this embodiment, by combining the PSNR and MS-SSIM two indexes to calculate the quality measurement value of the image, the calculated quality measurement value can approach the human subjective quality score.

[0080] As an implementation, the comprehensive evaluation score of the video quality of the corresponding link node can be obtained by aggregating the quality metric values of the frames.

[0081] As another implementation, the comprehensive evaluation score of the video quality of the corresponding link node can be obtained by averaging the quality metric values of the frames in the video of the link node. Specifically, the calculation formula of the comprehensive evaluation score of the video quality is as follows:

[0082]

[0083] In the formula, S represents the comprehensive evaluation score of the video quality of the corresponding link node, S n represents the quality metric value of the nth frame, and m represents the total number of frames of the video of the corresponding link node.

[0084] In step S5, the difference between the comprehensive evaluation scores of the video quality of the link nodes is calculated and taken as the transmission loss value between the corresponding link nodes.

[0085] In this step, the transmission loss value between the link nodes is the difference between the comprehensive evaluation scores of the video quality of the link nodes, that is, the calculation formula of the transmission loss value between the link nodes is as follows:

[0086] D αβ = |S α -S β |

[0087] In the formula, D αβ represents the transmission loss value between the link nodes α and β, S α represents the comprehensive evaluation score of the video quality of the link node α, and S β represents the comprehensive evaluation score of the video quality of the link node β.

[0088] In this embodiment, the difference between the comprehensive evaluation scores of the video quality of the link nodes is taken as the transmission loss value between the corresponding link nodes, and the calculation is simple and convenient. The calculated result can well reflect the transmission loss between the link nodes.

[0089] Further, the method can further include:

[0090] According to the obtained transmission loss values between the link nodes, a visual link diagram is generated.

[0091] In this embodiment, the transmission loss between the link nodes is represented by the visual link diagram, and the loss condition of the video data transmission link can be intuitively presented.

[0092] Further, the method can further include:

[0093] If the transmission loss value between the link nodes exceeds the preset transmission loss threshold, corresponding early warning information is sent out.

[0094] In this embodiment, automatic early warning based on the monitoring result can be realized.

[0095] Corresponding to the videoconferencing data transmission link quality loss monitoring method introduced in the above embodiments, the application also provides a videoconferencing data transmission link quality loss monitoring device, which is used to realize the above embodiments.

[0096] Please refer to Figure 2 , Figure 2 The structure connection block diagram of the videoconferencing data transmission link quality loss monitoring device provided by the embodiment of the application is shown.

[0097] The videoconferencing data transmission link quality loss monitoring device provided by the embodiment of the application comprises:

[0098] The sending module 1 is configured to generate a corresponding detection instruction according to the monitoring task configuration information and send the detection instruction to the videoconferencing terminal to be tested.

[0099] The first receiving module 2 is configured to receive a test video file generated by the videoconferencing terminal according to the detection instruction; the test video file of the videoconferencing terminal comprises video stream data collected according to the detection instruction and an update instruction obtained by appending the identifier of the videoconferencing terminal in the detection instruction.

[0100] The second receiving module 3 is configured to receive the test video file sent by each link node of the data transmission link corresponding to the videoconferencing terminal; the test video file sent by the link node is generated when the link node receives the video stream data with the detection instruction sent by the previous node; the test video file sent by the link node comprises an update instruction obtained by appending the identifier of the current link node in the received detection instruction and the received video stream data.

[0101] The first calculation module 4 is configured to calculate the quality metric value of each frame of image in the video of the corresponding link node according to the received test video file, and calculate the video quality comprehensive evaluation score value of the corresponding link node according to the obtained quality metric value.

[0102] The second calculation module 5 is configured to calculate the difference value of the video quality comprehensive evaluation score value between the link nodes as the transmission loss value between the corresponding link nodes.

[0103] In an implementable manner, the first calculation module 4 comprises:

[0104] The first calculation unit is configured to calculate a peak signal-to-noise ratio and a multi-scale structural similarity of each frame image in the corresponding link node video.

[0105] The second calculation unit is configured to obtain a quality measurement value of the corresponding frame image by weighting the calculated peak signal-to-noise ratio and multi-scale structural similarity values.

[0106] In an implementable manner, the second calculation module 5 comprises:

[0107] The third calculation unit is configured to average the quality measurement values of the frame images in the link node video to obtain a video quality comprehensive evaluation score value of the corresponding link node.

[0108] For the above-mentioned device embodiments, since they are basically similar to the method embodiments, the description is relatively simple, and the relevant parts are referred to the part of the description of the method embodiments. Figure 1 The relevant parts are referred to the part of the description of the method embodiments.

[0109] The application further provides a Web Real-Time Communication (WebRTC) data transmission link quality loss monitoring system.

[0110] Please refer to Figure 3 , Figure 3 Fig. 1 shows a structure schematic diagram of a WebRTC data transmission link quality loss monitoring system provided by an embodiment of the application.

[0111] As Figure 3 shown, the system of the embodiment of the application comprises a monitoring platform 10, a WebRTC terminal 20, and each link node 30 of the data transmission link corresponding to the WebRTC terminal 20;

[0112] The monitoring platform 10 is configured to generate a corresponding detection instruction according to monitoring task configuration information, and send the detection instruction to the corresponding WebRTC terminal 20 to be tested.

[0113] The WebRTC terminal 20 is configured to, when receiving the detection instruction, collect corresponding video stream data according to the detection instruction, attach a self-identity to the detection instruction to update the detection instruction, generate a test video file according to the current detection instruction and the collected video stream data, and feed back to the monitoring platform 10; and send the collected video stream data to the next link node 30 with the current detection instruction.

[0114] The link node 30 is configured to, when monitoring the video stream data with the detection instruction, attach a self-identity to the received detection instruction to update the detection instruction, generate a test video file according to the current detection instruction and the received video stream data, and feed back to the monitoring platform 10; and when the current link node 30 is not the link terminal, the link node 30 is further configured to send the received video stream data to the next link node 30 with the current detection instruction.

[0115] The monitoring platform 10 is further configured to calculate the quality metric value of each frame image in the video of the corresponding link node 30 according to the received test video file, calculate the video quality comprehensive evaluation score value of the corresponding link node 30 according to the obtained quality metric value, and calculate the difference value of the video quality comprehensive evaluation score value between the link nodes 30 as the transmission loss value between the corresponding link nodes 30.

[0116] In an implementable manner, the monitoring platform 10 is specifically configured to:

[0117] calculate the peak signal-to-noise ratio and the multi-scale structural similarity of each frame image in the video of the corresponding link node 30;

[0118] weight the calculated peak signal-to-noise ratio and multi-scale structural similarity value to obtain the quality metric value of the corresponding frame image.

[0119] In an implementable manner, the monitoring platform 10 is further specifically configured to:

[0120] average the quality metric values of the frame images in the video of the link node 30 to obtain the video quality comprehensive evaluation score value of the corresponding link node 30.

[0121] To implement the system described in the above embodiments, as shown in Figure 3 The monitoring task module 100, the instruction scheduling module 200, the video quality evaluation module 300, the data acquisition module 400, and the instruction processing module 500 can be correspondingly arranged.

[0122] Among them, the monitoring task module 100, the instruction scheduling module 200, and the video quality evaluation module 300 can be configured in the monitoring platform 10. The monitoring task module 100 is responsible for the management of the monitoring task, and stores the monitoring task configuration information. The instruction scheduling module 200 is configured to generate the detection instruction according to the monitoring task configuration information, and send the detection instruction to all eligible to-be-tested video live networking terminals 20. The video quality evaluation module 300 is configured to receive and analyze the test video file, obtain the detection instruction and the video stream data, and calculate the video quality comprehensive evaluation score value of each link node 30.

[0123] The data acquisition module 400 and the instruction processing module 500 can be deployed at the video networking terminal 20, and the instruction processing module 500 is deployed at each link node 30 of the data transmission link corresponding to the video networking terminal 20. The data acquisition module 400 is responsible for acquiring video stream data of a specific time length. The instruction processing module 500 is responsible for detecting the execution and updating of the instruction. When the instruction passes through the current link node 30, the instruction processing module 500 will update the link information of the detection instruction, append the identifier of the current link node 30 and the time in the original link information, and package the video stream data and the detection instruction for sending to the monitoring platform 10.

[0124] It should be noted that the meanings of the above parameters, processes, etc. Figure 1 are the same as the meanings of the related explanations in the .

[0125] The application further provides a video networking data transmission link quality loss monitoring device, comprising:

[0126] a memory for storing instructions; wherein the instructions are used to implement the video networking data transmission link quality loss monitoring method according to any one of the above embodiments;

[0127] a processor for executing the instructions in the memory.

[0128] The application further provides a computer readable storage medium, wherein the computer readable storage medium stores a computer program, and the computer program is executed by a processor to implement the video networking data transmission link quality loss monitoring method according to any one of the above embodiments.

[0129] The above embodiments of the application determine the transmission loss results of each node according to objective video quality evaluation scores, realize the monitoring of the data transmission link quality loss of the video networking, and the evaluation results are more in line with the sensory perception of actual users; through the scheme of the application, the transmission efficiency and data loss of the video networking terminal equipment in different links in each region can be tracked in real time, and reliable and intuitive reference basis can be provided for the performance optimization of the video networking link.

[0130] In several embodiments provided in the present application, it should be understood that the disclosed system, device and method can be implemented in other ways. For example, the device embodiments described above are only schematic, for example, the division of the modules is only a logical function division, and actual implementation can have another division manner, for example, a plurality of modules or components can be combined or integrated into another system, or some features can be ignored or not executed.

[0131] The modules described as separate components may or may not be physically separate, and the components shown as modules may or may not be physical modules, i.e., may be located in one place, or may be distributed to multiple network modules. Part or all of the modules can be selected according to actual needs to achieve the purpose of the embodiment scheme.

[0132] In addition, each functional module in each embodiment of the application can be integrated into a processing module, or each module can exist physically alone, or two or more modules can be integrated into one module. The integrated module can be realized in the form of hardware or in the form of a software functional module.

[0133] The integrated module, if realized in the form of a software functional module and sold or used as an independent product, can be stored in a computer-readable storage medium. Based on this understanding, the technical solutions of the application, essentially or the part that contributes to the prior art, or all or part of the technical solutions can be embodied in the form of a software product. The computer software product is stored in a storage medium, and includes a plurality of instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the method described in each embodiment of the application. The foregoing storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM, Read-Only Memory), a random access memory (RAM, Random Access Memory), a magnetic disk or an optical disk, and various program code storage media.

[0134] The above-described embodiments are only used to illustrate the technical solutions of the application, rather than limit them; although the application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that they can modify the technical solutions recorded in the foregoing embodiments, or make equivalent replacements to part of the technical features; and these modifications or replacements do not make the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the application.

Claims

1. A method for monitoring quality loss of a video over internet protocol data transmission link, the method comprising: The method comprises: generating corresponding detection instructions according to the monitoring task configuration information, and sending the detection instructions to the corresponding to-be-tested vision Internet terminal; receiving a test video file generated by the vision Internet terminal according to the detection instructions; the test video file of the vision Internet terminal comprises video stream data collected according to the detection instructions and an update instruction obtained by appending an identifier of the vision Internet terminal in the detection instructions; receiving a test video file sent by each link node of a data transmission link corresponding to the vision Internet terminal; the test video file sent by the link node is generated when the link node receives video stream data with a detection instruction sent by a previous node; the test video file sent by the link node comprises an update instruction obtained by appending an identifier of the current link node in the received detection instruction and the received video stream data; calculating a quality metric value of each frame image in the video of the corresponding link node according to the received test video file, and calculating a comprehensive evaluation score value of the video quality of the corresponding link node according to the obtained quality metric value; the comprehensive evaluation score value of the video quality of the corresponding link node is obtained based on the quality metric values of the frame images in the corresponding link node, or is obtained based on averaging the quality metric values of the frame images in the video of the link node; The difference of the video quality comprehensive evaluation score values between the link nodes is calculated and used as the transmission loss value between the corresponding link nodes; the calculation formula of the transmission loss value between the link nodes is: , wherein, represents the transmission loss value between the link nodes and , represents the video quality comprehensive evaluation score value of the link node , represents the video quality comprehensive evaluation score value of the link node .

2. The Web protocol data transmission link quality loss monitoring method of claim 1, wherein, the calculation of the quality metric value of each frame image in the video of the corresponding link node according to the received test video file comprises: calculating a peak signal-to-noise ratio and a multi-scale structural similarity of each frame image in the video of the corresponding link node; weighting the values of the calculated peak signal-to-noise ratio and multi-scale structural similarity to obtain the quality metric value of the corresponding frame image.

3. A video over internet protocol data transmission link quality degradation monitoring apparatus, characterized in that, The device comprises: a sending module configured to generate corresponding detection instructions according to the monitoring task configuration information, and send the detection instructions to the corresponding to-be-tested vision Internet terminal; a first receiving module configured to receive a test video file generated by the vision Internet terminal according to the detection instructions; the test video file of the vision Internet terminal comprises video stream data collected according to the detection instructions and an update instruction obtained by appending an identifier of the vision Internet terminal in the detection instructions; a second receiving module configured to receive a test video file sent by each link node of a data transmission link corresponding to the vision Internet terminal; the test video file sent by the link node is generated when the link node receives video stream data with a detection instruction sent by a previous node; the test video file sent by the link node comprises an update instruction obtained by appending an identifier of the current link node in the received detection instruction and the received video stream data; a first calculating module configured to calculate a quality metric value of each frame image in the video of the corresponding link node according to the received test video file, and calculate a comprehensive evaluation score value of the video quality of the corresponding link node according to the obtained quality metric value; the comprehensive evaluation score value of the video quality of the corresponding link node is obtained based on the quality metric values of the frame images in the corresponding link node, or is obtained based on averaging the quality metric values of the frame images in the video of the link node; The second calculation module is used for calculating the difference of the video quality comprehensive evaluation score value between the link nodes and taking the difference as the transmission loss value between the corresponding link nodes; the calculation formula of the transmission loss value between the link nodes is: , wherein, represents the transmission loss value between the link nodes and , represents the video quality comprehensive evaluation score value of the link node , represents the video quality comprehensive evaluation score value of the link node .

4. The Web protocol data transmission link quality loss monitoring apparatus of claim 3, wherein, the first calculating module comprises: The first computing unit is configured to calculate a peak signal-to-noise ratio and a multi-scale structural similarity of each frame image in the video of the corresponding link node. The second computing unit is configured to obtain a quality measurement value of the corresponding frame image by weighting the calculated peak signal-to-noise ratio and multi-scale structural similarity.

5. A visual internet network data transmission link quality loss monitoring system, characterized in that, The method comprises a monitoring platform, a video live streaming terminal, and each link node of a data transmission link corresponding to the video live streaming terminal. The monitoring platform is configured to generate a corresponding detection instruction according to the monitoring task configuration information, and send the detection instruction to the video live streaming terminal to be tested. The video live streaming terminal is configured to, when receiving the detection instruction, collect corresponding video stream data according to the detection instruction, attach a self-identity to the detection instruction to update the detection instruction, generate a test video file according to the current detection instruction and the collected video stream data, and feed back to the monitoring platform. The collected video stream data is sent to a next link node with the current detection instruction. The link node is configured to, when monitoring the video stream data with the detection instruction, attach a self-identity to the received detection instruction to update the detection instruction, generate a test video file according to the current detection instruction and the received video stream data, and feed back to the monitoring platform. The monitoring platform is further configured to calculate a quality measurement value of each frame image in the video of the corresponding link node according to the received test video file, and calculate a comprehensive evaluation score of the video quality of the corresponding link node according to the obtained quality measurement value. The difference between the video quality comprehensive evaluation score values of the link nodes is calculated and used as the transmission loss value between the corresponding link nodes; the video quality comprehensive evaluation score value of the corresponding link nodes is obtained based on the quality measurement values of each frame image in the corresponding link nodes, or is obtained by averaging the quality measurement values of each frame image in the link node video; and the calculation formula of the transmission loss value between the link nodes is: , wherein, represents the transmission loss value between the link nodes and , represents the video quality comprehensive evaluation score value of the link node , represents the video quality comprehensive evaluation score value of the link node .

6. The Web protocol television data transmission link quality impairment monitoring system of claim 5, wherein, The monitoring platform is specifically configured to: calculate a peak signal-to-noise ratio and a multi-scale structural similarity of each frame image in the video of the corresponding link node; and obtain a quality measurement value of the corresponding frame image by weighting the calculated peak signal-to-noise ratio and multi-scale structural similarity.

7. A video over internet protocol data transmission link quality degradation monitoring apparatus, comprising: The method comprises: a memory configured to store instructions; wherein the instructions are used to implement the video live streaming data transmission link quality loss monitoring method according to any one of claims 1-2. a processor configured to execute the instructions in the memory.

8. A computer-readable storage medium, characterized in that, The computer program stored on the computer readable storage medium is executed by the processor to implement the video live streaming data transmission link quality loss monitoring method according to any one of claims 1-2.

Images