Video transmission evaluation method and device, electronic equipment, storage medium and program product

Abstract

The embodiment of the invention provides a video transmission evaluation method and device, electronic equipment, a storage medium and a program product. The method comprises the steps that a first video stream of a panoramic video is transmitted in a preset transmission mode, first video data of the panoramic video are acquired, the first video stream corresponds to the preset transmission mode, and the first video data comprise first video quality data and first resource occupation data; acquiring second video data of the panoramic video when a second video stream of the panoramic video is transmitted, the second video stream being an original panoramic video stream of the panoramic video, the second video data including second video quality data and second resource occupation data; and performing performance evaluation on the preset transmission mode according to the first video data and the second video data to obtain a performance evaluation result of the preset transmission mode. According to the embodiment of the invention, by utilizing the technical scheme, the accuracy of the performance evaluation result of the transmission mode can be improved.

Description

Technical Field

[0001] This disclosure relates to the field of video transmission technology, and more particularly to a video transmission evaluation method, apparatus, electronic device, storage medium, and program product. Background Technology

[0002] Currently, in panoramic video transmission scenarios, there is a need to evaluate the transmission methods of panoramic video to determine the transmission performance of the corresponding methods. However, the performance evaluation methods in related technologies have low accuracy. Summary of the Invention

[0003] This disclosure provides a video transmission evaluation method, apparatus, electronic device, storage medium, and program product to improve the accuracy of performance evaluation of panoramic video transmission methods.

[0004] In a first aspect, embodiments of this disclosure provide a video transmission evaluation method, including:

[0005] A first video stream of panoramic video is transmitted using a preset transmission method, and first video data of the panoramic video is obtained. The first video stream corresponds to the preset transmission method, and the first video data includes first video quality data and first resource usage data.

[0006] When acquiring the second video stream of the panoramic video during transmission, the second video stream is the original panoramic video stream of the panoramic video, and the second video data includes second video quality data and second resource usage data.

[0007] The performance of the preset transmission method is evaluated based on the first video data and the second video data to obtain the performance evaluation result of the preset transmission method.

[0008] Secondly, embodiments of this disclosure also provide a video transmission evaluation apparatus, comprising:

[0009] The first acquisition module is used to transmit a first video stream of panoramic video using a preset transmission method and acquire the first video data of the panoramic video. The first video stream corresponds to the preset transmission method, and the first video data includes first video quality data and first resource usage data.

[0010] The second acquisition module is used to acquire the second video data of the panoramic video when transmitting the second video stream of the panoramic video. The second video stream is the original panoramic video stream of the panoramic video, and the second video data includes second video quality data and second resource usage data.

[0011] The performance evaluation module is used to evaluate the performance of the preset transmission method based on the first video data and the second video data, and obtain the performance evaluation result of the preset transmission method.

[0012] Thirdly, embodiments of this disclosure also provide an electronic device, including:

[0013] One or more processors;

[0014] Memory, used to store one or more programs.

[0015] When the one or more programs are executed by the one or more processors, the one or more processors implement the video transmission evaluation method as described in the embodiments of this disclosure.

[0016] Fourthly, embodiments of this disclosure also provide a computer-readable storage medium having a computer program stored thereon that, when executed by a processor, implements the video transmission evaluation method as described in embodiments of this disclosure.

[0017] Fifthly, embodiments of this disclosure also provide a computer program product that, when executed by a computer, enables the computer to implement the video transmission evaluation method as described in embodiments of this disclosure.

[0018] The video transmission evaluation method, apparatus, electronic device, storage medium, and program product provided in this disclosure evaluate the performance of the preset transmission method based on first video quality data and first resource usage data when transmitting panoramic video using a preset transmission method, and second video quality data and second resource usage data when transmitting the original panoramic video stream of the panoramic video. This can improve the accuracy of the performance evaluation results of the preset transmission method. Attached Figure Description

[0019] The above and other features, advantages, and aspects of the embodiments of this disclosure will become more apparent from the accompanying drawings and the following detailed description. Throughout the drawings, the same or similar reference numerals denote the same or similar elements. It should be understood that the drawings are schematic, and the originals and elements are not necessarily drawn to scale.

[0020] Figure 1 A flowchart illustrating a video transmission evaluation method provided in this embodiment of the disclosure;

[0021] Figure 2 A flowchart illustrating another video transmission evaluation method provided in this embodiment of the disclosure;

[0022] Figure 3 A schematic diagram of a data point and relationship curve provided in an embodiment of this disclosure;

[0023] Figure 4 A structural block diagram of a video transmission evaluation device provided in this disclosure embodiment;

[0024] Figure 5 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this disclosure. Detailed Implementation

[0025] Embodiments of this disclosure will now be described in more detail with reference to the accompanying drawings. While some embodiments of this disclosure are shown in the drawings, it should be understood that this disclosure can be implemented in various forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided to provide a more thorough and complete understanding of this disclosure. It should be understood that the accompanying drawings and embodiments of this disclosure are for illustrative purposes only and are not intended to limit the scope of protection of this disclosure.

[0026] It should be understood that the steps described in the method embodiments of this disclosure may be performed in different orders and / or in parallel. Furthermore, the method embodiments may include additional steps and / or omit the steps shown. The scope of this disclosure is not limited in this respect.

[0027] The term "comprising" and its variations as used herein are open-ended inclusions, meaning "including but not limited to". The term "based on" means "at least partially based on". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments". Definitions of other terms will be given in the description below.

[0028] It should be noted that the concepts of "first" and "second" mentioned in this disclosure are used only to distinguish different devices, modules or units, and are not used to limit the order of functions performed by these devices, modules or units or their interdependencies.

[0029] It should be noted that the terms "a" and "a plurality of" used in this disclosure are illustrative rather than restrictive, and those skilled in the art should understand that, unless otherwise expressly indicated in the context, they should be understood as "one or more".

[0030] The names of messages or information exchanged between multiple devices in the embodiments of this disclosure are for illustrative purposes only and are not intended to limit the scope of such messages or information.

[0031] It is understood that before using the technical solutions disclosed in the various embodiments of this disclosure, users should be informed of the types, scope of use, and usage scenarios of the personal information involved in this disclosure in an appropriate manner in accordance with relevant laws and regulations, and user authorization should be obtained.

[0032] For example, upon receiving a user's active request, a prompt message is sent to the user to explicitly inform them that the requested operation will require the acquisition and use of the user's personal information. This allows the user to independently choose whether to provide personal information to the software or hardware, such as the electronic device, application, server, or storage medium performing the operations of this disclosed technical solution, based on the prompt message.

[0033] As an optional but non-limiting implementation, in response to a user's active request, sending a prompt message to the user can be done via a pop-up window, where the prompt message can be presented in text format. Furthermore, the pop-up window can also include a selection control allowing the user to choose "agree" or "disagree" to provide personal information to the electronic device.

[0034] It is understood that the above notification and user authorization process are merely illustrative and do not constitute a limitation on the implementation of this disclosure. Other methods that comply with relevant laws and regulations may also be applied to the implementation of this disclosure.

[0035] It is understood that the data involved in this technical solution (including but not limited to the data itself, the acquisition or use of the data) shall comply with the requirements of relevant laws, regulations and related provisions.

[0036] Figure 1 This is a flowchart illustrating a video transmission evaluation method provided in an embodiment of this disclosure. The method can be executed by a video transmission evaluation device, which can be implemented in software and / or hardware and can be configured in an electronic device, typically a computer, mobile phone, or tablet. The video transmission evaluation method provided in this disclosure is applicable to scenarios where the performance of panoramic video transmission methods is evaluated.

[0037] In recent years, the field of Virtual Reality (VR) has been booming, with new head-mounted display products emerging one after another. These new products provide users with a more immersive experience through higher resolution, wider field of view, and stronger computing power. Furthermore, academic research has continuously developed solutions for VR, including high-performance solutions designed for different scenarios, achieving considerable gains in bandwidth, latency, and quality. Despite significant progress in VR, the lack of a practical and objective method for evaluating and comparing different solutions means that VR products often do not adopt the latest academic solutions. For example, some products still use full transmission (transmitting all panoramic video frames) to achieve 360-degree video (panoramic video) transmission.

[0038] The biggest challenge in evaluating transmission methods lies in balancing quality and cost (such as resource consumption) during the design of 360° video transmission methods. For example, some transmission methods may only consider transmitting a portion of the content displayed on the terminal device (such as a VR device) to reduce transmission bandwidth. The trade-off is that visual problems such as black borders and screen tearing may occur when the user suddenly moves their head violently. Conversely, transmitting more video content can eliminate these visual problems, but the corresponding bandwidth consumption will increase. This trade-off between quality and cost often requires evaluation of the specific transmission method to determine the best approach.

[0039] In related technologies, the evaluation methods for 360° video transmission mainly include several types: focusing solely on cost, focusing solely on quality, and considering both quality and cost. First, focusing solely on cost or solely on quality is not advisable; for practical deployment solutions, a trade-off between quality and cost must be considered. Second, regarding the comprehensive consideration of quality and cost, the evaluation methods in related technologies often fail to achieve performance comparisons between different solutions, and in certain specific situations, they may not reflect the true comparison results. For example, in some transmission methods, directly transmitting a low-resolution 300x300 panoramic video frame may result in a high performance score due to its low cost, failing to reflect the true performance of the corresponding transmission method.

[0040] In view of this, the present disclosure provides a video transmission evaluation method, which evaluates the performance of the preset transmission method based on first video quality data and first resource usage data when transmitting panoramic video using a preset transmission method, and second video quality data and second resource usage data when transmitting the original panoramic video stream of the panoramic video, thereby improving the accuracy of the performance evaluation results of the preset transmission method.

[0041] like Figure 1 As shown, the video transmission evaluation method provided in this embodiment may include:

[0042] S101. Transmit the first video stream of the panoramic video using a preset transmission method, and obtain the first video data of the panoramic video. The first video stream corresponds to the preset transmission method, and the first video data includes first video quality data and first resource usage data.

[0043] The preset transmission method can be understood as the current panoramic video transmission method to be evaluated. Different transmission methods can have different transmission parameters. For example, different transmission methods can transmit non-panoramic images in fields of view with different sizes, and / or the images transmitted by different transmission methods can have different resolutions, etc. The first video stream can be the video stream corresponding to the preset transmission method, that is, the video stream transmitted when using the preset transmission method for panoramic video transmission. The first video data can be understood as the video transmission data of the preset transmission method. The first video data includes first video quality data and first resource usage data. This first video quality data can be understood as the video quality data when transmitting panoramic video using the preset transmission method, such as a video quality score. The first video quality data can be used to characterize the video quality when transmitting panoramic video using the preset transmission method, such as the level of video quality. This first resource usage data can be understood as the resource usage data when transmitting panoramic video using the preset transmission method, such as the resource usage value. The first resource usage data can be used to characterize the resource usage when transmitting panoramic video using the preset transmission method, such as the amount of resources used.

[0044] Specifically, when it is necessary to evaluate the preset transmission method, the preset transmission method can be used to transmit panoramic video. For example, a first video stream of panoramic video can be generated based on the preset transmission method, and this first video stream can be sent to the VR device so that the VR device can render and display video frames based on this first video stream. When panoramic video is transmitted using the preset transmission method, the first video data of the panoramic video can be obtained, such as calculating or statistically analyzing the first video quality data and the first resource usage data of this video transmission.

[0045] In this embodiment, the first video quality data can be obtained by evaluating the video quality based on the first video stream and / or the video frame sequence displayed on the VR device side based on the first video stream. The specific evaluation method is not limited; for example, it can be obtained by using Video Multi-method Assessment Fusion (VMAF), Peak Signal-to-Noise Ratio (PSNR), and / or Structural Similarity (SSIM). Optionally, VMAF can be used to evaluate the first video quality data of the panoramic video, thereby representing the quality that the user can actually see in the VR device, i.e., the quality actually perceived by the user, further improving the accuracy of the performance evaluation results. The following explanation uses VMAF to evaluate the first video quality data of the panoramic video as an example.

[0046] When evaluating the first video quality data of a panoramic video, one approach is to directly use the video frame sequence displayed on the VR device without processing it, thus reducing the time spent on quality evaluation. Alternatively, one approach is to process the video frame sequence displayed on the VR device, such as processing abnormal video frames, and then perform quality evaluation based on the processed video frame sequence to obtain the first video quality data of the panoramic video. This improves the accuracy of the first video quality data and further enhances the accuracy of the performance evaluation results.

[0047] In some embodiments, acquiring the first video data of the panoramic video includes: acquiring a first video frame sequence displayed by a virtual reality device based on the first video stream, wherein the first video frame sequence includes multiple video frames; processing abnormal video frames in the multiple video frames to obtain a second video frame sequence; and performing a quality assessment on the panoramic video based on the second video frame sequence to obtain the first video quality data of the panoramic video.

[0048] The first video frame sequence can be understood as the sequence of video frames actually displayed by the VR device based on the first video stream; in other words, it is the sequence of video frames actually perceived by the user wearing the VR device. The first video frame sequence includes multiple video frames. These multiple video frames may include normal video frames, or may include or exclude abnormal video frames, depending on the actual display of the panoramic video on the VR device. Abnormal video frames can be understood as video frames that exhibit abnormalities during display, such as blank frames and / or missing video frames. Blank frames can be video frames that go out of bounds due to significant head rotation by the user, such as blank areas with black borders, distorted images, or other blank areas that do not display the actual video content. Missing video frames can be video frames that are lost due to congestion or decoding failure. The second video frame sequence can be understood as the sequence of video frames used for quality assessment of the panoramic video. It can be the video frame sequence obtained after processing the abnormal video frames in the first video frame sequence; that is, the first video frame sequence after processing the abnormal video frames.

[0049] For example, when acquiring the quality data of the first video frame of a panoramic video, the first video frame sequence displayed by the VR device based on the first video stream can be acquired. A second video frame sequence is determined based on the first video frame sequence. For instance, if there are abnormal video frames in the first video frame sequence, these abnormal video frames are processed, and the processed first video frame sequence is used as the second video frame sequence; if there are no abnormal video frames in the first video frame sequence, the first video frame sequence is used as the second video frame sequence. After obtaining the second video frame sequence, a quality assessment can be performed based on it, such as using VMAF to assess the quality of the second video frame sequence and obtain a quality assessment score for the second video frame sequence, which is used as the first video quality data of the panoramic video.

[0050] In this embodiment, the first video frame sequence may include blank frames and / or missing video frames, which are different types of abnormal frames caused by different reasons. The processing methods for different types of abnormal frames can be different to further improve the processing effect of abnormal video frames.

[0051] Optionally, processing the abnormal video frames in the multi-frame video sequence includes at least one of the following: for a first abnormal video frame in the multi-frame video sequence, filling the blank screen area in the first abnormal video frame with a preset filling method, wherein the first abnormal video frame includes a blank screen frame and the blank screen area exists in the blank screen frame; for a second abnormal video frame in the multi-frame video sequence, obtaining the non-lost video frame adjacent to the second abnormal video frame in the first video frame sequence, and adding the non-lost video frame to the position corresponding to the second abnormal video frame in the first video frame sequence, wherein the second abnormal video frame includes a lost video frame.

[0052] The first abnormal video frame can be understood as an abnormal video frame that is processed by filling in blank areas of the screen, such as a blank screen frame in the first video frame sequence containing blank areas. The second abnormal frame can be understood as an abnormal video frame that needs to be processed by copying other video frames, such as a missing video frame in the first video frame sequence. The non-lost video frame adjacent to the second abnormal video frame can be understood as the non-lost video frame in the first video frame sequence that is closest to the second abnormal video frame.

[0053] For example, for blank frames in the first video frame sequence, the blank areas in the blank frames that do not display actual video images can be filled using a preset filling method, such as filling the blank areas with preset colors such as black, white, or gray, to obtain the processed video frame; and / or, for lost video frames in the first video frame sequence, a non-lost video frame in the first video frame sequence can be obtained, such as obtaining a non-lost video frame adjacent to the lost video frame in the first video frame sequence, and copying the obtained non-lost video frame to the position of the lost video frame, thereby obtaining the processed video frame.

[0054] In this embodiment, the first resource occupancy data can be determined by statistically analyzing the resource occupancy of one or more resources during transmission. For example, the third resource occupancy data of one or more resources can be statistically analyzed, and the first resource occupancy data of the panoramic video can be calculated based on the third resource occupancy data of various resources. In this case, optionally, obtaining the first video data of the panoramic video includes: obtaining the third resource occupancy data of the panoramic video for at least one resource, wherein the at least one resource includes at least one of computing resources, storage resources, and transmission resources; and determining the first resource occupancy data of the panoramic video based on the third resource occupancy data.

[0055] The method of representing resource usage is not limited. For example, resource usage can be represented by a resource usage value, which can indicate the amount of resources used or the amount of virtual resources required to obtain the corresponding resources. Thirdly, resource usage data can be understood as resource usage data for a single type of resource, such as resource usage data for computing resources, storage resources, and / or transmission resources, etc. This computing resource can be understood as the resource used for data computation, such as the Central Processing Unit (CPU) resources used during data computation. This storage resource can be understood as the resource used for storage, such as memory resources. This transmission resource can be understood as the resource used for video streaming, such as bandwidth resources. The above-mentioned at least one resource may include, but is not limited to, computing resources, storage resources, and / or transmission resources. For example, the above-mentioned at least one resource may also include content generation resources or deployment resources. The following explanation uses the example of at least one resource including computing resources, storage resources, and transmission resources.

[0056] For example, third resource occupancy data of at least one resource used during panoramic video transmission using a preset transmission method can be obtained, such as third resource occupancy data of computing resources, storage resources, and transmission resources. Then, first resource occupancy data of the panoramic video can be determined based on the obtained third resource occupancy data. For instance, the weighted sum of the third resource occupancy data of computing resources, storage resources, and transmission resources can be used as the first resource occupancy data of the panoramic video. Here, the weights of different types of resources can be the same or different, and can be set as needed.

[0057] S102. Obtain the second video data of the panoramic video when transmitting the second video stream of the panoramic video. The second video stream is the original panoramic video stream of the panoramic video. The second video data includes second video quality data and second resource usage data.

[0058] The second video data can be understood as the video transmission data during the transmission of the original panoramic video stream. The second video data includes second video quality data and second resource usage data. The second video quality data can be understood as the video quality data during the transmission of the original panoramic video stream, such as a video quality score. The second video quality data can be used to characterize the video quality during the transmission of the original panoramic video stream, such as the level of video quality. The second resource usage data can be understood as the resource usage data during the transmission of the original panoramic video stream, such as the resource usage value. The second resource usage data can be used to characterize the resource usage during the transmission of the original panoramic video stream, such as the amount of resources used. The second video stream is the original panoramic video stream, meaning that the video frames in the second video stream are original panoramic video frames that have not undergone compression and / or cropping.

[0059] Specifically, the original panoramic video stream (i.e., the second video stream) can be transmitted, such as sending the original panoramic video stream to a VR device, so that the VR device can render and display video frames based on this original panoramic video stream. When transmitting the original panoramic video stream, the second video data of the panoramic video can be obtained, such as calculating or statistically analyzing the second video quality data and the second resource usage data of this video transmission. Here, the method for determining the second video quality data is similar to the method for determining the first video quality data; for details, please refer to the method for determining the first video quality data. The method for determining the second resource usage data is similar to the method for determining the first resource usage data; for details, please refer to the method for determining the first resource usage data. This embodiment will not elaborate further here.

[0060] It should be noted that the execution order of S101 and S102 is not limited. For example, S101 can be executed before or after S102, or it can be executed simultaneously with S102. The specific order can be set as needed.

[0061] S103. Based on the first video data and the second video data, the performance of the preset transmission method is evaluated to obtain the performance evaluation result of the preset transmission method.

[0062] In this step, after obtaining the first and second video data, the performance of the preset transmission method can be evaluated based on this data. For example, a performance evaluation score for the preset transmission method can be determined using the first and second data, thus obtaining the performance evaluation result. Subsequently, based on the performance evaluation result, it can be determined whether to use the preset transmission method for panoramic video transmission; and / or, based on the performance evaluation results of different transmission methods, including the preset method, one or more transmission methods can be selected for panoramic video transmission, etc., thereby improving the transmission effect of panoramic video.

[0063] The video transmission evaluation method provided in this embodiment transmits a first video stream of panoramic video using a preset transmission method and acquires first video data of the panoramic video. This first video stream corresponds to the preset transmission method, and the first video data includes first video quality data and first resource usage data. It then acquires second video data of the panoramic video when transmitting a second video stream, which is the original panoramic video stream. This second video data includes second video quality data and second resource usage data. Based on the first video data and the second video data, the performance of the preset transmission method is evaluated to obtain a performance evaluation result for the preset transmission method. This embodiment utilizes the above technical solution, based on the first video quality data and first resource usage data when transmitting panoramic video using the preset transmission method, and the second video quality data and second resource usage data when transmitting the original panoramic video stream, to perform a performance evaluation of the preset transmission method, thereby improving the accuracy of the performance evaluation result for the preset transmission method.

[0064] Figure 2 This is a flowchart illustrating another video transmission evaluation method provided in this embodiment. The scheme in this embodiment can be combined with one or more optional schemes in the above embodiments. Optionally, the step of evaluating the performance of the preset transmission method based on the first video data and the second video data to obtain the performance evaluation result of the preset transmission method includes: constructing a relationship curve between resource consumption data and video quality data based on the second video data and preset coefficients; and evaluating the performance of the preset transmission method based on the first video data and the relationship curve to obtain the performance evaluation result of the preset transmission method.

[0065] Correspondingly, such as Figure 2 As shown, the video transmission evaluation method provided in this embodiment may include:

[0066] S201. Transmit the first video stream of the panoramic video using a preset transmission method, and obtain the first video data of the panoramic video. The first video stream corresponds to the preset transmission method, and the first video data includes first video quality data and first resource usage data.

[0067] S202. When acquiring the second video stream of the panoramic video during transmission, the second video stream is the original panoramic video stream, and the second video data includes second video quality data and second resource usage data.

[0068] S203. Construct a relationship curve between resource usage data and video quality data based on the second video data and preset coefficients.

[0069] The relationship curve between resource usage data and video quality data can be a curve used to characterize the changing relationship between resource usage data and video quality data. For example, the independent variable (e.g., the horizontal axis) of this relationship curve can be video quality data, and the dependent variable (e.g., the vertical axis) can be resource usage data; or, the independent variable can be resource usage data, and the dependent variable can be video quality data. The following explanation uses this case as an example.

[0070] In this step, after obtaining the second video data, a relationship curve between resource usage data and video quality data can be constructed based on the second video data and preset coefficients. For example, a relationship curve between resource usage data and video quality data can be generated based on the second video data and preset coefficients using a preset formula between resource usage data and video quality data.

[0071] The preset relationship can be associated with the second video data and preset coefficients. It can be set as needed, simply ensuring that the resource usage data is positively correlated with the video quality data and passes through the data point corresponding to the second video data in the quality-resource usage coordinate system. This embodiment does not limit this. In some examples, the preset relationship between resource usage data and video quality data can be:

[0072] C = C FS -k×(Q FS -Q),Q m in≤Q≤Q FS

[0073] Where C represents resource usage data; C FSQ represents the second resource usage data; Q represents the video quality data; Q FS This is the second video quality data; Q min is the minimum value of the video quality data, which can be set in advance by relevant personnel as needed; k is a preset coefficient.

[0074] The preset coefficient can be set in advance; it can also be determined based on the application for which the performance of the preset transmission method is to be evaluated. For example, when the preset transmission method is deployed in applications with different quality weights and / or resource consumption weights, this preset coefficient may be different. Taking the application for which the performance of the preset transmission method is to be evaluated as the preset application, the preset coefficient can be determined based on the preset quality weight and preset resource consumption weight of the preset application. For example, the ratio between this preset quality weight and this preset resource consumption weight can be calculated, the ratio range to which this ratio belongs can be determined, and the coefficient value corresponding to this ratio range can be used as the aforementioned preset coefficient, etc. This embodiment does not limit the specific method of determining the preset coefficient. In this case, optionally, the first video stream and the second video stream are transmitted through the preset application. Before constructing the relationship curve between resource consumption data and video quality data based on the second video data and the preset coefficient, the method further includes: determining the preset coefficient based on the preset quality weight and preset resource consumption weight of the preset application. The preset quality weight can be used to indicate the preset application's preference for video quality; the preset resource consumption weight can be used to indicate the preset application's preference for resource consumption.

[0075] S204. Based on the first video data and the relationship curve, the performance of the preset transmission method is evaluated to obtain the performance evaluation result of the preset transmission method.

[0076] Specifically, after obtaining the relationship curve between resource usage data and video quality data, the performance of the preset transmission method can be evaluated based on the first video data and this relationship curve to obtain the performance evaluation result of the preset transmission method.

[0077] In this embodiment, the performance evaluation method based on the relationship curve between the first video data, resource usage data, and video quality data can be set as needed. For example, the performance of a preset transmission method can be evaluated based on the relative position of the data point corresponding to the first video data in the quality-resource usage coordinate system and this relationship curve, thus obtaining the performance evaluation result of the preset transmission method.

[0078] In some implementations, the performance of a preset transmission method can be evaluated based on the distance between the data point corresponding to the first video data in the quality-resource usage coordinate system and the relationship curve between resource usage data and video quality data. Optionally, in this case, the performance evaluation of the preset transmission method based on the first video data and the relationship curve to obtain the performance evaluation result of the preset transmission method includes: calculating the distance between the data point corresponding to the first video data and the relationship curve based on the first video data; and calculating the performance evaluation score of the preset transmission method based on the distance between the data point and the relationship curve, as the performance evaluation result of the preset transmission method.

[0079] For example, the first video quality data Q0 in the first video data can be used as the coordinate value of the quality coordinate axis, and the first resource usage data C0 in the first video data can be used as the coordinate value of the resource usage coordinate axis to determine the data point (C0, Q0) corresponding to the first video data in the quality-resource usage coordinate system, such as... Figure 3 As shown. Calculate the distance between this data point and the curve relating resource usage data and video quality data, such as calculating the Euclidean distance between this data point and the curve relating resource usage data and video quality data. Then, a performance evaluation score for the preset transmission method can be calculated based on this distance. For example, this distance can be used as the performance evaluation score for the preset transmission method, or the distance can be further normalized to a preset score range (e.g., 0-100), and the normalized distance value can be used as the performance evaluation score for the preset transmission method, and so on.

[0080] Taking the Euclidean distance between the data points corresponding to the first video data and the relationship curve between resource usage data and video quality data as the performance evaluation score of the preset transmission method as an example, its performance evaluation score PI (Performance Index) can be:

[0081]

[0082] Where C0 is the first resource usage data, C FS The second set of resource usage data is q0, and the first set of video quality data is q. FS This represents the second video quality data, and k is a preset coefficient.

[0083] In this embodiment, the performance evaluation results of the same preset transmission method may differ in different applications. Taking the application for which the performance evaluation of the preset transmission method is to be performed as an example, the performance of the preset transmission method can be evaluated based on the relationship curve between the first video data, resource usage data, and video quality data to obtain the performance evaluation result of the preset transmission method in this preset application. In this case, optionally, the performance evaluation of the preset transmission method based on the first video data and the relationship curve to obtain the performance evaluation result of the preset transmission method includes: performing the performance evaluation of the preset transmission method based on the first video data and the relationship curve to obtain the performance evaluation result of the preset transmission method in the preset application.

[0084] In this embodiment, the performance of different types of panoramic video transmission schemes (i.e., transmission methods) can be evaluated using the evaluation metric PI. For example, for each transmission scheme to be evaluated, this embodiment can statistically analyze its corresponding cost (i.e., first resource usage data) and quality (i.e., first video quality data), mapping them to a point (i.e., a data point) in the Quality-Cost space (i.e., the quality-resource usage coordinate system). Then, the point corresponding to the cost and quality when transmitting panoramic video in its original format can be used as a baseline point (Full Streaming, FS), and a baseline curve can be defined in the Quality-Cost space starting from this baseline point. This constructs a curve relating resource usage data and video quality data, and this baseline can terminate at the lowest acceptable quality q. min At the baseline, the performance of all points on the line is consistent with the performance of the benchmark. For quality-sensitive applications, Q... min Setting the Q value relatively high will result in a flatter overall curve, requiring significant cost reductions to see even slight quality changes; however, for cost-sensitive applications, Q... min Setting the value relatively low, meaning a steeper overall curve, allows for significant quality improvements even with moderate cost reductions. Next, the Euclidean distance between the data points and the baseline corresponding to this transmission scheme can be calculated as the PI value for that scheme; a higher PI value indicates better performance. Furthermore, PI can be positive or negative, with positive values ​​corresponding to better performance than negative values.

[0085] Therefore, this embodiment uses the PI (Performance Index) to measure the performance of different types of panoramic video transmission schemes, effectively resolving the trade-off between quality (i.e., video quality data) and cost (i.e., resource consumption data). Specifically, the video transmission evaluation method provided in this embodiment can obtain quality and cost parameters for different schemes to evaluate different types of panoramic video transmission schemes, demonstrating universality. Compared to some evaluation schemes in related technologies, this embodiment can effectively evaluate different types of schemes, ensuring that the evaluation results themselves are reasonable, i.e., effective. Furthermore, this embodiment can set a baseline (such as setting a preset coefficient) based on the application's own preferences for quality or cost, thereby evaluating different schemes under different types of requirements, demonstrating adaptability.

[0086] The video transmission evaluation method provided in this embodiment constructs a relationship curve between resource occupancy data and video quality data based on the second video data and preset coefficients; and performs performance evaluation on the preset transmission method based on the first video data and this relationship curve to obtain the performance evaluation result of the preset transmission method, which can further improve the accuracy of the performance evaluation result.

[0087] Figure 4 This is a structural block diagram of a video transmission evaluation device provided in an embodiment of this disclosure. The device can be implemented in software and / or hardware, and can be configured in an electronic device, typically a computer, mobile phone, or tablet computer. It can evaluate the performance of panoramic video transmission methods by executing video transmission evaluation methods. Figure 4 As shown, the video transmission evaluation device provided in this embodiment may include: a first acquisition module 401, a second acquisition module 402, and a performance evaluation module 403, wherein,

[0088] The first acquisition module 401 is used to transmit a first video stream of panoramic video using a preset transmission method and acquire the first video data of the panoramic video. The first video stream corresponds to the preset transmission method, and the first video data includes first video quality data and first resource usage data.

[0089] The second acquisition module 402 is used to acquire the second video data of the panoramic video when transmitting the second video stream of the panoramic video. The second video stream is the original panoramic video stream of the panoramic video, and the second video data includes second video quality data and second resource usage data.

[0090] The performance evaluation module 403 is used to perform a performance evaluation on the preset transmission method based on the first video data and the second video data, and obtain the performance evaluation result of the preset transmission method.

[0091] The video transmission evaluation device provided in this embodiment transmits a first video stream of panoramic video using a preset transmission method through a first acquisition module, and acquires the first video data of the panoramic video. This first video stream corresponds to the preset transmission method, and the first video data includes first video quality data and first resource usage data. A second acquisition module acquires the second video data of the panoramic video when transmitting a second video stream. This second video stream is the original panoramic video stream, and the second video data includes second video quality data and second resource usage data. A performance evaluation module performs a performance evaluation of the preset transmission method based on the first video data and the second video data to obtain a performance evaluation result for the preset transmission method. This embodiment utilizes the above technical solution to perform a performance evaluation of the preset transmission method based on the first video quality data and first resource usage data when transmitting panoramic video using the preset transmission method, and the second video quality data and second resource usage data when transmitting the original panoramic video stream, thereby improving the accuracy of the performance evaluation result of the preset transmission method.

[0092] Optionally, the first acquisition module 401 includes: a sequence acquisition unit, configured to acquire a first video frame sequence displayed by the virtual reality device based on the first video stream, wherein the first video frame sequence includes multiple video frames; an anomaly processing unit, configured to process anomaly video frames in the multiple video frames to obtain a second video frame sequence; and a quality assessment unit, configured to perform a quality assessment on the panoramic video based on the second video frame sequence to obtain first video quality data of the panoramic video.

[0093] Optionally, the anomaly handling unit may specifically perform at least one of the following: for a first abnormal video frame in the multi-frame video frame, fill the blank screen area in the first abnormal video frame with a preset filling method, wherein the first abnormal video frame includes a blank screen frame and the blank screen area exists in the blank screen frame; for a second abnormal video frame in the multi-frame video frame, obtain the non-lost video frame adjacent to the second abnormal video frame in the first video frame sequence, and add the non-lost video frame to the position corresponding to the second abnormal video frame in the first video frame sequence, wherein the second abnormal video frame includes a lost video frame.

[0094] Optionally, the first acquisition module 401 includes: a first data determination unit, configured to acquire third resource occupancy data of the panoramic video for at least one resource, wherein the at least one resource includes at least one of computing resources, storage resources, and transmission resources; and a second data determination unit, configured to determine first resource occupancy data of the panoramic video based on the third resource occupancy data.

[0095] Optionally, the performance evaluation module 403 includes: a curve construction unit, used to construct a relationship curve between resource usage data and video quality data based on the second video data and preset coefficients; and a performance evaluation unit, used to perform performance evaluation on the preset transmission method based on the first video data and the relationship curve, and obtain the performance evaluation result of the preset transmission method.

[0096] Optionally, the first video stream and the second video stream are transmitted through a preset application. The video transmission evaluation device may further include: a coefficient determination module, used to determine the preset coefficient based on the preset quality weight and preset resource usage weight of the preset application before constructing the relationship curve between resource usage data and video quality data based on the second video data and the preset coefficient; the performance evaluation unit may be specifically used to: perform performance evaluation on the preset transmission method based on the first video data and the relationship curve, and obtain the performance evaluation result of the preset transmission method in the preset application.

[0097] Optionally, the performance evaluation unit may be specifically used to: calculate the distance between the data point corresponding to the first video data and the relationship curve based on the first video data; calculate the performance evaluation score of the preset transmission method based on the distance between the data point and the relationship curve, and use it as the performance evaluation result of the preset transmission method.

[0098] The video transmission evaluation apparatus provided in this disclosure can execute the video transmission evaluation method provided in any embodiment of this disclosure, and has the corresponding functional modules and beneficial effects for executing the video transmission evaluation method. Technical details not described in detail in this embodiment can be found in the video transmission evaluation method provided in any embodiment of this disclosure.

[0099] The following is for reference. Figure 5 The diagram illustrates a structural schematic of an electronic device (e.g., a head-mounted display device or a server) 500 suitable for implementing embodiments of the present disclosure. The terminal devices in the embodiments of the present disclosure may include, but are not limited to, mobile terminals such as mobile phones, laptops, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), in-vehicle terminals (e.g., in-vehicle navigation terminals), and fixed terminals such as digital TVs and desktop computers. Figure 5 The electronic device shown is merely an example and should not be construed as limiting the functionality and scope of the embodiments disclosed herein.

[0100] like Figure 5As shown, the electronic device 500 may include a processing unit (e.g., a central processing unit, a graphics processor, etc.) 501, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 502 or a program loaded from a storage device 508 into a random access memory (RAM) 503. The RAM 503 also stores various programs and data required for the operation of the electronic device 500. The processing unit 501, ROM 502, and RAM 503 are interconnected via a bus 504. An input / output (I / O) interface 505 is also connected to the bus 504.

[0101] Typically, the following devices can be connected to I / O interface 505: input devices 506 including, for example, touchscreens, touchpads, keyboards, mice, cameras, microphones, accelerometers, gyroscopes, etc.; output devices 507 including, for example, liquid crystal displays (LCDs), speakers, vibrators, etc.; storage devices 508 including, for example, magnetic tapes, hard disks, etc.; and communication devices 509. Communication device 509 allows electronic device 500 to communicate wirelessly or wiredly with other devices to exchange data. Although Figure 5 An electronic device 500 with various devices is shown; however, it should be understood that it is not required to implement or possess all of the devices shown. More or fewer devices may be implemented or possessed alternatively.

[0102] In particular, according to embodiments of this disclosure, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, embodiments of this disclosure include a computer program product comprising a computer program carried on a non-transitory computer-readable medium, the computer program containing program code for performing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via a communication device 509, or installed from a storage device 508, or installed from a ROM 502. When the computer program is executed by the processing device 501, it performs the functions defined in the methods of embodiments of this disclosure.

[0103] It should be noted that the computer-readable medium described in this disclosure can be a computer-readable signal medium or a computer-readable storage medium, or any combination thereof. A computer-readable storage medium can be, for example,—but not limited to—an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of a computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof. In this disclosure, a computer-readable storage medium can be any tangible medium containing or storing a program that can be used by or in connection with an instruction execution system, apparatus, or device. In this disclosure, a computer-readable signal medium can include a data signal propagated in baseband or as part of a carrier wave, carrying computer-readable program code. Such propagated data signals can take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. A computer-readable signal medium can be any computer-readable medium other than a computer-readable storage medium, which can send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium can be transmitted using any suitable medium, including but not limited to: wires, optical fibers, RF (radio frequency), etc., or any suitable combination thereof.

[0104] In some implementations, clients and servers can communicate using any currently known or future-developed network protocol such as HTTP (Hypertext Transfer Protocol) and can interconnect with digital data communication (e.g., communication networks) of any form or medium. Examples of communication networks include local area networks (“LANs”), wide area networks (“WANs”), the Internet (e.g., the Internet of Things), and peer-to-peer networks (e.g., ad hoc peer-to-peer networks), as well as any currently known or future-developed networks.

[0105] The aforementioned computer-readable medium may be included in the aforementioned electronic device; or it may exist independently and not assembled into the electronic device.

[0106] The aforementioned computer-readable medium carries one or more programs. When the electronic device executes the aforementioned one or more programs, the electronic device causes the following to occur: transmit a first video stream of panoramic video using a preset transmission method, and acquire first video data of the panoramic video, wherein the first video stream corresponds to the preset transmission method, and the first video data includes first video quality data and first resource usage data; acquire second video data of the panoramic video when transmitting a second video stream of the panoramic video, wherein the second video stream is the original panoramic video stream of the panoramic video, and the second video data includes second video quality data and second resource usage data; and perform a performance evaluation of the preset transmission method based on the first video data and the second video data to obtain a performance evaluation result of the preset transmission method.

[0107] Computer program code for performing the operations of this disclosure can be written in one or more programming languages ​​or a combination thereof, including but not limited to object-oriented programming languages ​​such as Java, Smalltalk, and C++, as well as conventional procedural programming languages ​​such as the "C" language or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer can be connected to the user's computer via any type of network—including a local area network (LAN) or a wide area network (WAN)—or can be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0108] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.

[0109] The units described in the embodiments of this disclosure can be implemented in software or hardware. The names of modules do not, in some cases, constitute a limitation on the unit itself.

[0110] The functions described above in this document can be performed, at least in part, by one or more hardware logic components. For example, exemplary types of hardware logic components that can be used, without limitation, include: Field Programmable Gate Arrays (FPGAs), Application-Specific Integrated Circuits (ASICs), Application Standard Products (ASSPs), System-on-Chip (SoCs), Complex Programmable Logic Devices (CPLDs), and so on.

[0111] In the context of this disclosure, a machine-readable medium can be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, apparatus, or device. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can be, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. More specific examples of machine-readable storage media include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.

[0112] According to one or more embodiments of this disclosure, Example 1 provides a video transmission evaluation method, including:

[0113] A first video stream of panoramic video is transmitted using a preset transmission method, and first video data of the panoramic video is obtained. The first video stream corresponds to the preset transmission method, and the first video data includes first video quality data and first resource usage data.

[0114] When acquiring the second video stream of the panoramic video during transmission, the second video stream is the original panoramic video stream of the panoramic video, and the second video data includes second video quality data and second resource usage data.

[0115] The performance of the preset transmission method is evaluated based on the first video data and the second video data to obtain the performance evaluation result of the preset transmission method.

[0116] According to one or more embodiments of this disclosure, Example 2, based on the method described in Example 1, the step of acquiring the first video data of the panoramic video includes:

[0117] Obtain a first video frame sequence displayed by the virtual reality device based on the first video stream, wherein the first video frame sequence includes multiple video frames;

[0118] The abnormal video frames in the multi-frame video are processed to obtain a second video frame sequence;

[0119] The panoramic video is evaluated for quality based on the second video frame sequence to obtain the first video quality data of the panoramic video.

[0120] According to one or more embodiments of this disclosure, Example 3, based on the method of Example 2, involves processing abnormal video frames in the multi-frame video array, including at least one of the following:

[0121] For the first abnormal video frame in the multi-frame video, a preset filling method is used to fill the blank screen area in the first abnormal video frame, wherein the first abnormal video frame includes a blank screen frame, and the blank screen frame contains the blank screen area.

[0122] For the second abnormal video frame in the multi-frame video sequence, obtain the non-lost video frame adjacent to the second abnormal video frame in the first video frame sequence, and add the non-lost video frame to the position corresponding to the second abnormal video frame in the first video frame sequence, wherein the second abnormal video frame includes a lost video frame.

[0123] According to one or more embodiments of this disclosure, Example 4, based on the method described in Example 1, the step of acquiring the first video data of the panoramic video includes:

[0124] Obtain third resource occupancy data of the panoramic video for at least one resource, wherein the at least one resource includes at least one of computing resources, storage resources, and transmission resources;

[0125] The first resource occupancy data of the panoramic video is determined based on the third resource occupancy data.

[0126] According to one or more embodiments of this disclosure, Example 5 describes the method described in any of Examples 1-4, wherein the performance evaluation of the preset transmission method based on the first video data and the second video data, to obtain the performance evaluation result of the preset transmission method, includes:

[0127] A relationship curve between resource usage data and video quality data is constructed based on the second video data and preset coefficients.

[0128] The performance of the preset transmission method is evaluated based on the relationship curve between the first video data and the preset transmission method, and the performance evaluation result of the preset transmission method is obtained.

[0129] According to one or more embodiments of this disclosure, Example 6, based on the method described in Example 5, further includes transmitting the first video stream and the second video stream through a preset application, and prior to constructing the relationship curve between resource usage data and video quality data based on the second video data and preset coefficients:

[0130] The preset coefficient is determined based on the preset quality weight and preset resource consumption weight of the preset application;

[0131] The step of evaluating the performance of the preset transmission method based on the first video data and the relationship curve to obtain the performance evaluation result of the preset transmission method includes:

[0132] The performance of the preset transmission method is evaluated based on the first video data and the relationship curve, and the performance evaluation result of the preset transmission method in the preset application is obtained.

[0133] According to one or more embodiments of this disclosure, Example 7 describes the method described in Example 5, wherein the performance evaluation of the preset transmission method based on the first video data and the relationship curve, to obtain the performance evaluation result of the preset transmission method, includes:

[0134] Based on the first video data, calculate the distance between the data point corresponding to the first video data and the relationship curve;

[0135] The performance evaluation score of the preset transmission method is calculated based on the distance between the data point and the relationship curve, and is used as the performance evaluation result of the preset transmission method.

[0136] According to one or more embodiments of this disclosure, Example 8 provides a video transmission evaluation apparatus, comprising:

[0137] The first acquisition module is used to transmit a first video stream of panoramic video using a preset transmission method and acquire the first video data of the panoramic video. The first video stream corresponds to the preset transmission method, and the first video data includes first video quality data and first resource usage data.

[0138] The second acquisition module is used to acquire the second video data of the panoramic video when transmitting the second video stream of the panoramic video. The second video stream is the original panoramic video stream of the panoramic video, and the second video data includes second video quality data and second resource usage data.

[0139] The performance evaluation module is used to evaluate the performance of the preset transmission method based on the first video data and the second video data, and obtain the performance evaluation result of the preset transmission method.

[0140] According to one or more embodiments of this disclosure, Example 9 provides an electronic device, including:

[0141] One or more processors;

[0142] Memory, used to store one or more programs.

[0143] When the one or more programs are executed by the one or more processors, the one or more processors implement the video transmission evaluation method as described in any of Examples 1-7.

[0144] According to one or more embodiments of the present disclosure, Example 10 provides a computer-readable storage medium having a computer program stored thereon that, when executed by a processor, implements the video transmission evaluation method as described in any of Examples 1-7.

[0145] According to one or more embodiments of this disclosure, Example 11 provides a computer program product that, when executed by a computer, causes the computer to implement the video transmission evaluation method as described in any of Examples 1-7.

[0146] The above description is merely a preferred embodiment of this disclosure and an explanation of the technical principles employed. Those skilled in the art should understand that the scope of this disclosure is not limited to technical solutions formed by specific combinations of the above-described technical features, but should also cover other technical solutions formed by arbitrary combinations of the above-described technical features or their equivalents without departing from the above-described concept. For example, technical solutions formed by substituting the above features with (but not limited to) technical features disclosed in this disclosure that have similar functions.

[0147] Furthermore, while the operations are described in a specific order, this should not be construed as requiring these operations to be performed in the specific order shown or in a sequential order. In certain environments, multitasking and parallel processing may be advantageous. Similarly, while several specific implementation details are included in the above discussion, these should not be construed as limiting the scope of this disclosure. Certain features described in the context of individual embodiments may also be implemented in combination in a single embodiment. Conversely, various features described in the context of a single embodiment may also be implemented individually or in any suitable sub-combination in multiple embodiments.

[0148] Although the subject matter has been described using language specific to structural features and / or methodological logic, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or actions described above. Rather, the specific features and actions described above are merely illustrative examples of implementing the claims.

Claims

1. A video transmission evaluation method, characterized in that, include: A first video stream of panoramic video is transmitted using a preset transmission method, and first video data of the panoramic video is obtained. The first video stream corresponds to the preset transmission method, and the first video data includes first video quality data and first resource usage data. When acquiring the second video stream of the panoramic video during transmission, the second video stream is the original panoramic video stream of the panoramic video, and the second video data includes second video quality data and second resource usage data. The performance of the preset transmission method is evaluated based on the first video data and the second video data to obtain the performance evaluation result of the preset transmission method.

2. The method according to claim 1, characterized in that, The acquisition of the first video data of the panoramic video includes: Obtain a first video frame sequence displayed by the virtual reality device based on the first video stream, wherein the first video frame sequence includes multiple video frames; The abnormal video frames in the multi-frame video are processed to obtain a second video frame sequence; The panoramic video is evaluated for quality based on the second video frame sequence to obtain the first video quality data of the panoramic video.

3. The method according to claim 2, characterized in that, The processing of abnormal video frames in the multi-frame video frame sequence includes at least one of the following: For the first abnormal video frame in the multi-frame video, a preset filling method is used to fill the blank screen area in the first abnormal video frame, wherein the first abnormal video frame includes a blank screen frame, and the blank screen frame contains the blank screen area. For the second abnormal video frame in the multi-frame video sequence, obtain the non-lost video frame adjacent to the second abnormal video frame in the first video frame sequence, and add the non-lost video frame to the position corresponding to the second abnormal video frame in the first video frame sequence, wherein the second abnormal video frame includes a lost video frame.

4. The method according to claim 1, characterized in that, The acquisition of the first video data of the panoramic video includes: Obtain third resource occupancy data of the panoramic video for at least one resource, wherein the at least one resource includes at least one of computing resources, storage resources, and transmission resources; The first resource occupancy data of the panoramic video is determined based on the third resource occupancy data.

5. The method according to any one of claims 1-4, characterized in that, The step of evaluating the performance of the preset transmission method based on the first video data and the second video data to obtain the performance evaluation result of the preset transmission method includes: A relationship curve between resource usage data and video quality data is constructed based on the second video data and preset coefficients. The performance of the preset transmission method is evaluated based on the relationship curve between the first video data and the preset transmission method, and the performance evaluation result of the preset transmission method is obtained.

6. The method according to claim 5, characterized in that, The first video stream and the second video stream are transmitted through a preset application. Before constructing the relationship curve between resource consumption data and video quality data based on the second video data and preset coefficients, the method further includes: The preset coefficient is determined based on the preset quality weight and preset resource consumption weight of the preset application; The step of evaluating the performance of the preset transmission method based on the first video data and the relationship curve to obtain the performance evaluation result of the preset transmission method includes: The performance of the preset transmission method is evaluated based on the first video data and the relationship curve, and the performance evaluation result of the preset transmission method in the preset application is obtained.

7. The method according to claim 5, characterized in that, The step of evaluating the performance of the preset transmission method based on the first video data and the relationship curve to obtain the performance evaluation result of the preset transmission method includes: Based on the first video data, calculate the distance between the data point corresponding to the first video data and the relationship curve; The performance evaluation score of the preset transmission method is calculated based on the distance between the data point and the relationship curve, and is used as the performance evaluation result of the preset transmission method.

8. A video transmission evaluation device, characterized in that, include: The first acquisition module is used to transmit a first video stream of panoramic video using a preset transmission method and acquire the first video data of the panoramic video. The first video stream corresponds to the preset transmission method, and the first video data includes first video quality data and first resource usage data. The second acquisition module is used to acquire the second video data of the panoramic video when transmitting the second video stream of the panoramic video. The second video stream is the original panoramic video stream of the panoramic video, and the second video data includes second video quality data and second resource usage data. The performance evaluation module is used to evaluate the performance of the preset transmission method based on the first video data and the second video data, and obtain the performance evaluation result of the preset transmission method.

9. An electronic device, characterized in that, include: At least one processor; as well as A memory communicatively connected to the at least one processor; wherein, The memory stores a computer program that can be executed by the at least one processor, the computer program being executed by the at least one processor to enable the at least one processor to perform the video transmission evaluation method according to any one of claims 1-7.

10. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer instructions that cause a processor to execute the video transmission evaluation method according to any one of claims 1-7.

11. A computer program product, characterized in that, The computer program product includes a computer program that, when executed by a processor, implements the video transmission evaluation method according to any one of claims 1-7.

Images