Multi-format video adaptive transmission method and device, electronic equipment and storage medium

Abstract

The application provides a multi-format video adaptive transmission method and device, electronic equipment and storage medium. A video receiving utility increment model is constructed by a video receiving end, and a video sending utility increment model is obtained by a video sending end. Then, a controller processes the received video receiving utility increment model and the received video sending utility increment model through a video transmission utility algorithm, and constructs a video transmission utility model considering both the video receiving end and the video sending end. Therefore, the video transmission utility model is processed by a balancing algorithm, and a target transmission strategy balancing user viewing experience and video coding load can be obtained. Thus, the adaptive transmission of the video can be realized by controlling the video sending end and the video receiving end according to the target transmission strategy, and the viewing experience can be improved while reducing the load.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of communication, and particularly relates to a multi-format video adaptive transmission method and device, electronic equipment and storage medium. BACKGROUND

[0002] Frame rate is the frequency of a bitmap image in frames appearing on a display in succession, which determines the fluency of a video picture. In general, the higher the frame rate, the more fluent the animation effect of the video.

[0003] However, if the high frame rate output is maintained for a long time, the load in the transmission process will be increased, and it is difficult to support by a mobile terminal with limited resources. Therefore, how to reduce the load while improving the viewing experience has become a problem to be solved. SUMMARY

[0004] Therefore, the present application aims to provide a multi-format video adaptive transmission method and device, electronic equipment and storage medium to solve the above technical problems.

[0005] To achieve the above purpose, the first aspect of the present application provides a multi-format video adaptive transmission method applied to a video adaptive transmission system, wherein the system comprises a controller, a video sending end and at least one video receiving end connected in communication, and the method comprises the following steps:

[0006] The video receiving end acquires resource request parameters and sends the resource request parameters to the video sending end;

[0007] The video sending end determines resource configuration parameters based on the received resource request parameters and sends the resource configuration parameters to the video receiving end;

[0008] The video receiving end processes the resource request parameters and the received resource configuration parameters through a video receiving utility algorithm, constructs a video receiving utility increment model, and sends the video receiving utility increment model to the controller;

[0009] The video sending end processes the resource configuration parameters and the received resource request parameters through a video sending utility algorithm, obtains a video sending utility increment model, and sends the video sending utility increment model to the controller;

[0010] The controller processes the received video receiving utility increment model and the received video sending utility increment model through a video transmission utility algorithm, constructs a video transmission utility model, processes the video transmission utility model through a balancing algorithm, obtains a target transmission strategy corresponding to a maximum value of the video transmission utility model, and controls the video sending end and the video receiving end to perform a video transmission process according to the target transmission strategy.

[0011] Based on the same inventive concept, a second aspect of the present application provides a multi-format video adaptive transmission device, which is arranged in a video adaptive transmission system, the system comprising a controller, a video sending end and at least one video receiving end connected in communication, and the device comprising:

[0012] The video receiving end is configured to obtain resource request parameters, send the resource request parameters to the video sending end, process the resource request parameters and received resource configuration parameters through a video receiving utility algorithm, construct a video receiving utility increment model, and send the video receiving utility increment model to the controller.

[0013] The video sending end is configured to determine resource configuration parameters based on the received resource request parameters, send the resource configuration parameters to the video receiving end, process the resource configuration parameters and received resource request parameters through a video sending utility algorithm, obtain a video sending utility increment model, and send the video sending utility increment model to the controller.

[0014] The controller is configured to process the received video receiving utility increment model and the received video sending utility increment model through a video transmission utility algorithm, construct a video transmission utility model, process the video transmission utility model through a balancing algorithm, obtain a target transmission strategy corresponding to a maximum value of the video transmission utility model, and control the video sending end and the video receiving end to perform a video transmission process according to the target transmission strategy.

[0015] Based on the same inventive concept, a third aspect of the present application provides an electronic device comprising a memory, a processor, and a computer program stored on the memory and executable by the processor, wherein the processor implements the method of the first aspect when executing the computer program.

[0016] Based on the same inventive concept, a fourth aspect of the present application provides a non-transitory computer readable storage medium storing computer instructions for causing a computer to execute the method of the first aspect.

[0017] From the above, it can be seen that the multi-format video adaptive transmission method, device, electronic equipment and storage medium provided by the application, through the video receiving end according to the resource request parameter and the received resource configuration parameter, through the video receiving utility algorithm for processing, constructing the video receiving utility increment model, and using the video sending end according to the resource configuration parameter and the received resource request parameter, through the video sending utility algorithm for processing, obtaining the video sending utility increment model, then using the controller according to the received video receiving utility increment model and the received video sending utility increment model, through the video transmission utility algorithm for processing, constructing the video transmission utility model considering the video receiving end and the video sending end, therefore through the balancing algorithm to process the video transmission utility model, the target transmission strategy of dynamic balance user watching experience and video coding load can be obtained, so as to control the video sending end and the video receiving end according to such target transmission strategy to realize the adaptive transmission of video, and then the watching experience can be improved while reducing the load. BRIEF DESCRIPTION OF DRAWINGS

[0018] In order to more clearly illustrate the technical solutions in the application or related art, the following will briefly introduce the drawings needed to be used in the embodiments or related art description. Obviously, the drawings in the following description are only embodiments of the application, and other drawings can be obtained by those skilled in the art without creative labor.

[0019] Figure 1 The high frame rate video transmission scene schematic diagram of the embodiment of the application;

[0020] Figure 2 The flow chart of the multi-format video adaptive transmission method of the embodiment of the application;

[0021] Figure 3 The structural block diagram of the multi-format video adaptive transmission device of the embodiment of the application;

[0022] Figure 4 The schematic diagram of the electronic equipment of the embodiment of the application. DETAILED DESCRIPTION

[0023] In order to make the purpose, technical scheme and advantages of the application more clear, the following will be further described in detail in combination with specific embodiments and with reference to the drawings.

[0024] It should be noted that, unless otherwise defined, technical terms or scientific terms used in the embodiments of the present application shall have the common meaning understood by one of ordinary skill in the art to which the embodiments of the present application belong. The terms "first", "second", and similar terms used in the embodiments of the present application do not denote any order, quantity, or importance, but are used to distinguish different components. The terms "include", "contain", and similar terms mean that the elements or objects before the terms encompass the elements or objects listed after the terms and their equivalents, and do not exclude other elements or objects. The terms "connect" or "connected" and similar terms do not mean physical or mechanical connection, but can include electrical connection, whether direct or indirect. The terms "upper", "lower", "left", "right", and the like are used only to represent relative positional relationships, and when the absolute positions of the described objects change, the relative positional relationships can also change accordingly.

[0025] It can be understood that, before using the technical solutions of the various embodiments of the present application, the user will be informed of the type, scope of use, and use scenario of the personal information involved in a proper manner, and the user's authorization will be obtained.

[0026] For example, in response to receiving the user's active request, the user is sent prompt information to explicitly prompt the user that the operation requested to be performed will require the acquisition and use of the user's personal information. Thus, the user can choose whether to provide personal information to the electronic device, application program, server, or storage medium, etc. software or hardware that performs the operation of the technical solutions of the present application according to the prompt information.

[0027] As an optional but non-limiting implementation, in response to accepting the user's active request, the way of sending prompt information to the user may, for example, be a pop-up window, in which the prompt information can be presented in the form of text. In addition, the pop-up window can also carry selection controls for the user to select "agree" or "disagree" to provide personal information to the electronic device.

[0028] It can be understood that the above notification and user authorization process is only illustrative and does not limit the implementation of the present application, and other ways that meet the relevant laws and regulations can also be applied to the implementation of the present application.

[0029] Frame rate, as an important ultra-high-definition video parameter, is usually ignored in adaptive video transmission. Compared with other components such as resolution and dynamic range, the frame rate is generally pre-set to be fixed at 30 frames per second (FPS), and sometimes a larger value is used, but rarely exceeds 60 FPS.

[0030] With the advancement of hardware technology, advanced cameras have gradually become popular, and high frame rate (HFR) videos can be captured and processed more easily. Therefore, a new trend has emerged in the field of video services, and high frame rate videos have entered the daily life of ordinary people. Intuitively, using high frame rate videos can effectively alleviate motion blur and reduce the spatial displacement between frames when an object moves by increasing the number of video frames, as shown in Figure 1 However, for high-speed motion scenes, hundreds of frames are still needed to restore the scene, reproduce optical reality, and present it to the video receiving end in a more realistic way.

[0031] Maintaining long-term high frame rate output is not simple. On the one hand, high frame rate can lead to an increase in data traffic. According to a report measurement, increasing the frame rate from 60FPS to 120FPS will result in an additional increase of more than 41.7% in data. In the tests of the present application, it is verified that the amount of video data with high spatial information (SI) / temporal information (TI) can be reduced. With further increase in frame rate, this data traffic will grow, thereby increasing the load of the video sending end and the network during transmission. On the other hand, high frame rate will result in additional resource consumption. The increase in the number of frames, especially B frames (inter-frame compression algorithm using bidirectional prediction encoding) and P frames (a type of video frame that compresses the data of the current frame according to the differences between the current frame and the adjacent previous frame), makes the computing demand in the video service process greater. For the video sending end, this is an additional long-term load in real time, and for each video receiving end device, the received frame data is decoded for display. This additional computing is difficult to support by resource-constrained mobile terminals and is also difficult to be universally accepted.

[0032] The present application considers dynamically adjusting the frame rate of a video to make the playback smoother and balance the video receiving end experience and the resource consumption for video transmission, establishes a close coupling relationship between the frame rate control and the resource consumption for video transmission, designs a bilateral control strategy for video sending end-video receiving end negotiation, establishes a closed-loop optimization process of utility feedback, and dynamically balances the user experience and the load for video encoding and decoding.

[0033] Embodiments of the present application provide a multi-format video adaptive transmission method. According to the resource request parameters and the received resource configuration parameters, the video receiving end is processed by a video receiving utility algorithm, a video receiving utility increment model is constructed, and according to the resource configuration parameters and the received resource request parameters, the video sending end is processed by a video sending utility algorithm to obtain a video sending utility increment model. Then, according to the received video receiving utility increment model and the received video sending utility increment model, the controller is processed by a video transmission utility algorithm to construct a video transmission utility model considering the video receiving end and the video sending end. Therefore, by processing the video transmission utility model by the balancing algorithm, the target transmission strategy of dynamically balancing the user viewing experience and the video coding load can be obtained, so that the video adaptive transmission of the video sending end and the video receiving end can be realized according to the target transmission strategy, and the viewing experience can be improved while reducing the load.

[0034] As shown in Figure 2 The method is applied to a video adaptive transmission system, and the system includes a controller, a video sending end and at least one video receiving end connected in communication. The method includes the following steps:

[0035] In step 201, the video receiving end obtains resource request parameters and sends the resource request parameters to the video sending end.

[0036] In this step, the resource request parameters represent the resource consumption required to obtain the video, and the video receiving end represents a video receiving end device for viewing the video.

[0037] The user viewing the video inputs voice or text in the message input area of the session window of the video receiving end, and after sending, the resource request parameters can be obtained.

[0038] Different control buttons for obtaining resource request parameters can also be set in the session window of the video receiving end, and the user viewing the video can trigger the corresponding control buttons to obtain the resource request parameters according to the requirements, or the session window can be customized to input the resource request parameters.

[0039] In step 202, the video sending end determines the resource configuration parameters based on the received resource request parameters and sends the resource configuration parameters to the video receiving end.

[0040] In this step, the resource configuration parameters are used to measure the display quality of the video, for example, the resource configuration parameters can be the frame rate, the video sending end represents a video sending device for encoding real-time streaming media content into high-quality video, and the video sending end can be a virtualized cloud server.

[0041] The resource request parameter affects the resource configuration parameter, and the video sending end can quickly determine the resource configuration parameter based on the resource request parameter, such as Figure 1 As shown in the figure, real-time streaming media is generated by a video generator (Video Generator) and uploaded to a server (Server), and the server (i.e., the video sending end) encodes the real-time streaming media content to form a video (Video Stream) and sends it to the video receiving end (Viewer).

[0042] In the process of transmitting the video to the video receiving end, the frame rate control (Frame Rate Control) of the video can be low frame rate (LOW), median frame rate (Median), or high frame rate (High), which is determined based on the resource request parameter sent by the video receiving end (Viewer).

[0043] In addition, the frame rate can affect the display quality of the video. For example, a high frame rate video has relatively less motion blur and more coherent space shift between adjacent two frames of images, so that the user experience (Experience) of the video receiving end is improved when the video is transmitted to the terminal station (Terminal), i.e., transmitted to the video receiving end (i.e., the video receiving end).

[0044] Step 203, the video receiving end processes the resource request parameter and the received resource configuration parameter through a video receiving utility algorithm, constructs a video receiving utility increment model, and sends the video receiving utility increment model to the controller.

[0045] In this step, in order to establish bilateral cooperation between the video sending end and the video receiving end, a video transmission utility model considering both the video receiving end and the video sending end is constructed, and the video receiving utility increment model is quickly constructed by the video receiving utility algorithm.

[0046] The video receiving utility increment model is used to indicate the user experience of the video receiving end.

[0047] Step 204, the video sending end processes the resource configuration parameter and the received resource request parameter through a video sending utility algorithm, obtains a video sending utility increment model, and sends the video sending utility increment model to the controller.

[0048] In this step, in order to establish bilateral cooperation between the video sending end and the video receiving end, a video transmission utility model considering both the video receiving end and the video sending end is constructed, and the video sending utility increment model is quickly constructed by the video sending utility algorithm.

[0049] The video sending utility increment model is used to indicate the load for video coding and decoding.

[0050] At step 205, the controller processes the received video receiving utility increment model and the received video sending utility increment model through a video transmission utility algorithm, constructs a video transmission utility model, and processes the video transmission utility model through a balancing algorithm to obtain a target transmission strategy corresponding to the maximum value of the video transmission utility model, and controls the video sending end and the video receiving end to perform a video transmission process according to the target transmission strategy.

[0051] In this step, bilateral cooperation between the video sending end and the video receiving end is established, and the target transmission strategy is not made unilaterally, but based on the video receiving utility increment model of the video receiving end and the video sending utility increment model of the video sending end, and the relationship between the two is balanced.

[0052] The target transmission strategy dynamically balances the user viewing experience and the load for video coding and decoding, so that the video sending end and the video receiving end can realize adaptive transmission of the video according to such a target transmission strategy, and thus the viewing experience can be improved while the load is reduced.

[0053] Through the above scheme, the video receiving end processes the resource request parameter and the received resource configuration parameter through a video receiving utility algorithm to construct a video receiving utility increment model, the video sending end processes the resource configuration parameter and the received resource request parameter through a video sending utility algorithm to obtain a video sending utility increment model, and then the controller processes the received video receiving utility increment model and the received video sending utility increment model through a video transmission utility algorithm to construct a video transmission utility model that comprehensively considers the video receiving end and the video sending end. Therefore, the target transmission strategy dynamically balances the user viewing experience and the load for video coding and decoding through the balancing algorithm processing the video transmission utility model, so that the video sending end and the video receiving end can realize adaptive transmission of the video according to such a target transmission strategy, and thus the viewing experience can be improved while the load is reduced.

[0054] In some embodiments, the resource configuration parameter includes a first resource receiving consumption parameter, a first video frame rate parameter, a second resource receiving consumption parameter, and a second video frame rate parameter, and the resource request parameter includes a first quality of experience parameter, a first resource acquisition consumption parameter, a second quality of experience parameter, and a second resource acquisition consumption parameter.

[0055] In step 203, the video receiving end processes the video receiving utility algorithm according to the resource request parameter and the received resource configuration parameter, constructs a video receiving utility increment model, including:

[0056] In step A1, the video receiving end constructs a first video receiving utility model according to the first video frame rate parameter, the first resource acquisition consumption parameter, the first resource receiving consumption parameter, the first quality of experience parameter and a preset weight factor through the following formula:

[0057]

[0058] Wherein, Q(f) represents the first video receiving utility model, f * represents the first video frame rate parameter, p * represents the first resource acquisition consumption parameter, c * represents the first resource receiving consumption parameter, r * represents the first quality of experience parameter, and λ represents the weight factor.

[0059] In step A2, the video receiving end constructs a second video receiving utility model according to the second video frame rate parameter, the second resource acquisition consumption parameter, the second resource receiving consumption parameter, the second quality of experience parameter and a preset weight factor through the following formula:

[0060]

[0061] Wherein, Q(f) represents the second video receiving utility model, f d represents the second resource acquisition consumption parameter, c d represents the second resource receiving consumption parameter, r d represents the second quality of experience parameter, and λ represents the weight factor.

[0062] In step A3, the video receiving end constructs the video receiving utility increment model based on the first video receiving utility model and the second video receiving utility model through the following formula:

[0063]

[0064] Wherein, Q*(f*)=(r*-c*)·f*

[0065] Q d (f d )=(r d -c d )·f d , λ represents the weight factor, and f* p represents the first video frame rate parameter. * f represents the parameter consumed in acquiring the first resource. d This represents the second video frame rate parameter. This represents the first video reception utility model. This represents the second video reception utility model, p d p represents the parameter for acquiring the second resource. d c is 0 * f represents the first resource reception consumption parameter. * c represents the first experience quality parameter. d Indicates the second resource reception consumption parameter, r d This represents the second quality parameter of the experience.

[0066] In the above scheme, it is assumed that the initial fixed video frame rate is f. d (i.e., the second video frame rate parameter), the video receiver can achieve frame rate f without using resource request parameters. d Enjoy videos without consuming additional resources.

[0067] Let f n This represents the viewing frame rate at the video receiver n. After receiving a video frame, the average frame loss c used for decoding and displaying that frame is calculated. n (That is, the resource reception consumption parameter) is consumed. During this process, the video receiver n obtains a smooth viewing experience from the frames. The resulting experience quality parameter r... n (i.e., QoE) is the cost of p at the video receiver n. n The resource request parameter is used as the frame rate. The utility representation of the video receiver n is as follows:

[0068]

[0069] Where λ is the weighting factor. For convenience, let Q... n (f n )=(r n -c n )·f n Therefore, changes in the frame rate transmission result in changes in the Q value at the video receiver. n (f n )=(r n -c n )·f n It also changes accordingly. Conversely, by comparing it with a fixed video frame rate f d To make comparisons, an incremental model of video reception utility was introduced.

[0070]

[0071] Among them, K n(f n )=Q n (f n )-Q d (f d )

[0072] That is, the video receiving end constructs a first video receiving utility model according to the first video frame rate parameter, the first resource acquisition consumption parameter, the first resource receiving consumption parameter, the first quality of experience parameter and a preset weight factor through the following formula:

[0073]

[0074] Wherein, represents the first video receiving utility model, f* represents the first video frame rate parameter, p * represents the first resource acquisition consumption parameter, c * represents the first resource receiving consumption parameter, f * represents the first quality of experience parameter, and λ represents the weight factor.

[0075] The video receiving end constructs a second video receiving utility model according to the second video frame rate parameter, the second resource acquisition consumption parameter, the second resource receiving consumption parameter, the second quality of experience parameter and a preset weight factor through the following formula:

[0076]

[0077] Wherein, represents the second video receiving utility model, fd represents the second video frame rate parameter, p d represents the second resource acquisition consumption parameter, c d represents the second resource receiving consumption parameter, r d represents the second quality of experience parameter, and λ represents the weight factor.

[0078] The video receiving end constructs the video receiving utility increment model based on the first video receiving utility model and the second video receiving utility model through the following formula:

[0079]

[0080] Wherein, Q*(f*)=(r*-c*)·f*

[0081] Q d (f d )=(r d -c d )·f d , λ represents the weight factor, f *represents a first video frame rate parameter, p * represents a first resource acquisition cost parameter, f d represents a second video frame rate parameter, represents a first video receiving utility model, represents a second video receiving utility model, pd represents a second resource acquisition cost parameter, p d is 0, c * represents a first resource receiving cost parameter, r * represents a first quality of experience parameter, c d represents a second resource receiving cost parameter, r d represents a second quality of experience parameter.

[0082] In some embodiments, the resource configuration parameters include: a first resource sending cost parameter, a first video frame rate parameter, a second resource sending cost parameter, and a second video frame rate parameter, and the resource request parameters include: a first resource acquisition cost parameter and a second resource acquisition cost parameter.

[0083] In step 204, the video sending end processes the resource configuration parameters and the received resource request parameters through a video sending utility algorithm to obtain a video sending utility increment model, including:

[0084] In step B1, the video sending end constructs a first video sending utility model according to the first video frame rate parameter, the first resource acquisition cost parameter, a preset weight factor, and the first resource sending utility parameter through the following formula:

[0085]

[0086] wherein, represents a first video sending utility model, f* represents a first video frame rate parameter, p * represents a first resource acquisition cost parameter, λ represents a weight factor, and C(f * ) represents a first resource sending cost parameter.

[0087] In step B2, the video sending end constructs a second video sending utility model according to the second video frame rate parameter, the second resource acquisition cost parameter, a preset weight factor, and the second resource sending utility parameter through the following formula:

[0088]

[0089] wherein, represents a second video sending utility model, fd represents a second video frame rate parameter, p d represents a second resource acquisition cost parameter, λ represents a weight factor, and C(f d) represents the second resource sending consumption parameter.

[0090] Step B3, the video sending end builds the video sending utility increment model based on the first video sending utility model and the second video sending utility model through the following formula:

[0091]

[0092] wherein, represents the video sending utility increment model, represents the first video sending utility model, represents the second video sending utility model, and λ represents a weight factor. * represents the first video frame rate parameter, * represents the first resource acquisition consumption parameter, d represents the second video frame rate parameter, d is 0, and C(f * ) represents the first resource sending consumption parameter, and C(f d ) represents the second resource sending consumption parameter.

[0093] In the above scheme, as a video sending end, the cloud server plays the role of a video sending end. It encodes and transmits video content at a frame rate f n (including a fixed video frame rate f d ), to generate a video frame rate parameter C(f n ), which includes computing resources, transmission delay, etc.

[0094] According to the experimental results, the consumption is proportional to the size of the frame rate. In this application, it is regarded as a monotonically increasing convex function, and the video sending end provides comprehensive content services for any video receiving end n. The resource acquisition consumption parameter p n of the video receiving end n is naturally transferred to the video receiving end. The video sending utility model of the video sending end can be represented as follows:

[0095]

[0096] Similarly, as the frame rate changes, the video sending utility model will also adjust. Corresponding to the video service of the fixed video frame rate f d , the video sending utility model is represented as follows:

[0097]

[0098] wherein, H n (f n ) = c(f n ) + C(f d).

[0099] The video sending end constructs a first video sending utility model according to the first video frame rate parameter, the first resource acquisition consumption parameter, a preset weight factor and the first resource sending utility parameter through the following formula:

[0100]

[0101] Among them, The first video sending utility model is represented by f * The first video frame rate parameter is represented by f * The first resource acquisition consumption parameter is represented by p * The first resource sending consumption parameter is represented by C(f

[0102] The video sending end constructs a second video sending utility model according to the second video frame rate parameter, the second resource acquisition consumption parameter, a preset weight factor and the second resource sending utility parameter through the following formula:

[0103]

[0104] Among them, The second video sending utility model is represented by fd d The second resource acquisition consumption parameter is represented by p d The second resource sending consumption parameter is represented by C(f

[0105] The video sending end constructs the video sending utility increment model based on the first video sending utility model and the second video sending utility model through the following formula:

[0106]

[0107] Among them, The video sending utility increment model is represented by f The first video sending utility model is represented by f The second video sending utility model is represented by fd * The first video frame rate parameter is represented by f * The first resource acquisition consumption parameter is represented by p d The second video frame rate parameter is represented by f d The second resource acquisition consumption parameter is represented by p d The first resource sending consumption parameter is represented by C(f * The second resource sending consumption parameter is represented by C(f d ).

[0108] In some embodiments, in step 205, the controller constructs a video transmission utility model by processing the received video receiving utility increment model and the received video sending utility increment model through a video transmission utility algorithm, including:

[0109] The controller, in response to the number of video receiving ends being 1, constructs the video transmission utility model according to the received video receiving utility increment model and the received video sending utility increment model through the following formula:

[0110]

[0111] wherein, represents the received video sending utility increment model, represents the first video sending utility model, represents the second video sending utility model, * represents the first video frame rate parameter, * represents the first resource acquisition consumption parameter, d represents the second video frame rate parameter, represents the second resource acquisition consumption parameter, represents the received video receiving utility increment model, represents the first video receiving utility model, represents the second video receiving utility model.

[0112] In the above scheme, the expected purpose is to improve the viewing experience while reducing the load, that is, to maintain the overall benefit of the video service process, which is the optimization target.

[0113] The optimization target is used to describe the total sum of the video receiving utility increment model of the video receiving end and the video sending utility increment model of the video sending end in the entire video service process, and is defined as follows:

[0114]

[0115] Adaptive transmission based on bilateral negotiation:

[0116] As shown in the optimization target above, the expected purpose is to establish a balance between the video frame rate and the resource acquisition consumption parameter in the dynamic external environment. As participants in the video service, the video sending end and the video receiving end have different inclinations and influence each other. Changes in one can directly affect the other, making cooperative control of frame rate more difficult. The present application negotiates through a cooperation framework, which can establish a link between participants and reach a consensus on decision-making to optimize their own purposes. It provides a feasible idea for solving existing problems.

[0117] First, a negotiation task Two task performers are involved, namely the video sender S and the video receiver v. When the two task performers agree on the balance between the video frame rate and the resource acquisition consumption parameters through negotiation, a protocol a = (f n , p n ) is reached. Let and be the feasible regions of the video frame rate f n and the resource acquisition consumption parameter p n , respectively. The negotiation result of any protocol constitutes the available space On the other hand, the negotiation can not meet the expectations of both participants, resulting in a disagreement D. Both parties should not adjust their measurements, and the situation will remain unchanged. For convenience, the alternative feasible regions of both parties are denoted as Then, both parties obtain as a result. The ultimate goal is to achieve a Nash equilibrium without any change in the external environment, without any task performer having the motivation to change the protocol. If the following four conditions are met, there is a unique negotiation equilibrium, such as Pareto efficiency, symmetry, invariance to affine transformations, and independence from irrelevant alternatives.

[0118] The utility of the task performer is monotonically increasing and convex. The Nash negotiation solution in equilibrium can be defined and solved by the Nash product.

[0119] The Nash negotiation solution (NBS) can be obtained by the optimal protocol a * = {f * , p *}, which obtains the utility for both task performers if the following Nash product is maximized.

[0120]

[0121] where and are the utilities in the disagreement case, it can be seen that the elements in the Nash product consist of the video receiving utility increment model and the video receiving utility increment model of both parties in the protocol.

[0122] Therefore, the Nash negotiation solution expects to reach the protocol of the participants as much as possible to improve the value of the video transmission utility model, rather than remaining in disagreement.

[0123] The following is a bilateral cooperation with a single video receiver, which satisfies the above four axioms such as Pareto efficiency, symmetry, invariance to affine transformations, and independence from irrelevant alternatives.

[0124] The scenario includes a video sender and a video receiver. In this case, one-to-one, the video sender provides full video service to a single video receiver. Let the single video receiver be video receiver n. The agreement reached between the task performers is represented as a n = {f n , p n}.

[0125] According to and The original Nash product can be derived as follows:

[0126]

[0127] wherein, represents a first video sending utility model, represents a second video sending utility model, represents a first video receiving utility model, represents a second video receiving utility model, f * represents a first video frame rate parameter, p * represents a first resource acquisition consumption parameter, f d represents a second video frame rate parameter, p d represents a second resource acquisition consumption parameter, p d is 0, Q * (f * ) = (r * -c * )·f * Q d (f d ) = (r d -c d )·f d , c * represents a first resource receiving consumption parameter, r * represents a first quality of experience parameter, c d represents a second resource receiving consumption parameter, r d represents a second quality of experience parameter, C(f * ) represents a first resource sending consumption parameter, C(f d ) represents a second resource sending consumption parameter;

[0128] The controller determines a first target video frame rate parameter and a first target resource acquisition consumption parameter based on the maximum value of the video transmission utility model, and takes the target video frame rate parameter and the target resource acquisition consumption parameter as the target transmission strategy.

[0129] In some embodiments, in step 205, the video transmission utility model is processed by an equalization algorithm to obtain a target transmission strategy corresponding to a maximum value of the video transmission utility model, including:

[0130] In step C1, the controller processes the video transmission utility model based on a reverse induction algorithm to obtain a maximum value of the video transmission utility model by the following formula:

[0131]

[0132] wherein, represents a first video sending utility model, represents a second video sending utility model, represents a first video receiving utility model, represents a second video receiving utility model, * represents a first video frame rate parameter, * represents a first resource acquisition consumption parameter, d represents a second video frame rate parameter, d represents a second resource acquisition consumption parameter, d is 0, Q * (f * ) = (r * -c * )·f * Q d (f d ) = (r d -c d )·f d , c * represents a first resource receiving consumption parameter, * represents a first quality of experience parameter, d represents a second resource receiving consumption parameter, d represents a second quality of experience parameter, C(f * ) represents a first resource sending consumption parameter, and C(f d ) represents a second resource sending consumption parameter.

[0133] In step C2, the controller determines a first target video frame rate parameter and a first target resource acquisition consumption parameter based on the maximum value of the video transmission utility model, and takes the target video frame rate parameter and the target resource acquisition consumption parameter as the target transmission strategy.

[0134] In the above scheme, the following is the bilateral cooperation with a single video receiving end, to meet the above four axioms such as Pareto efficiency, symmetry, invariance to affine transformation and independence of irrelevant alternatives.

[0135] The scenario includes one video sender and one video receiver. In this case, one-to-one, the video sender provides comprehensive video services to a single video receiver. Let the single video receiver be video receiver n. The agreement reached between the task performers is represented as a n = {f n , p n}.

[0136] According to and The original Nash product can be derived as follows:

[0137]

[0138] Equation (A) is derived from the formula and Equation (B) comes from the formula Equation (C) introduces ζ n = K n -p n . Obviously, it is a strictly convex quadratic function. When the optimal is obtained, the corresponding video frame rate and resource acquisition consumption parameter can also be generated.

[0139] In order to derive the optimal solution, a reverse induction method is introduced. First, consider any given video frame rate The optimal can be obtained by solving the convex optimization problem. Second, the optimal is substituted into the formula The original problem can be converted into a function about f n : This is equivalent to maximizing Θ(f n ), that is, The equivalence of the Nash negotiation solution and the maximization of Θ(f n ) shows that each participant can only obtain the maximum value of the video receiving utility increment model and the maximum value of the video receiving utility increment model by achieving the maximum overall utility. This is because the transferable utility of both parties, specifically the resource acquisition consumption parameter p n .

[0140] In some embodiments, in step 205, the controller constructs a video transmission utility model by processing the received video receiving utility increment model and the received video sending utility increment model through a video transmission utility algorithm, including:

[0141] The controller, in response to the number of video receiving ends being greater than or equal to 2, constructs the video transmission utility model according to the received video receiving utility increment model and the received video sending utility increment model through the following formula:

[0142] ( n (Δ Θ -ζ n )

[0143] Wherein, represents the received video sending utility increment model, represents the received video receiving utility increment model, represents the video frame rate of other video receiving ends, represents the second target video frame rate, fd represents the second video frame rate parameter, represents the service utility increment when multiple video receiving ends reach a consensus, represents the service utility increment when multiple video receiving ends do not reach a consensus but still reuse the second video frame rate parameter, ζ n represents the utility increment of the video receiving end.

[0144] In the above scheme, the expected purpose is to improve the viewing experience while reducing the load, that is, to maintain the overall benefit of the video service process, which is the optimization target.

[0145] The optimization target is used to describe the total sum of the video receiving utility increment model of the video receiving end and the video sending utility increment model of the video sending end in the entire video service process, and is defined as follows:

[0146]

[0147] Adaptive transmission based on bilateral negotiation:

[0148] As shown in the optimization target above, the expected purpose is to establish a balance between the video frame rate and the resource acquisition consumption parameter in a dynamic external environment. As participants in the video service, the video sending end and the video receiving end have different inclinations and influence each other. Changes in one can directly affect the other, making cooperative control of the frame rate more difficult. The present application negotiates through a cooperative framework, which can establish a link between participants and reach a consensus on decision-making to optimize their own purposes. It provides a feasible idea for solving existing problems.

[0149] First, a negotiation task is established Including two task executors, namely the video sender S and the video receiver R When the two task executors agree on the balance between the video frame rate and the resource acquisition consumption parameter through negotiation, a protocol a = (f n , p n ) is reached. Let and be the feasible regions of the video frame rate f n and the resource acquisition consumption parameter p n , respectively. The negotiation result of any protocol constitutes the available space On the other hand, negotiation may not meet the expectations of both participants, resulting in a disagreement D. Both sides should not adjust their measurements, and the situation will remain unchanged. For convenience, the alternative feasible regions of both sides are denoted as Then, both sides obtain as a result. The ultimate goal is to achieve a Nash equilibrium without any changes in the external environment, without any task executor having the motivation to change the protocol. If the following four conditions are met, there is a unique negotiation equilibrium, such as Pareto efficiency, symmetry, invariance to affine transformations, and independence from irrelevant alternatives.

[0150] The utility of the task executors is monotonically increasing and convex. The Nash negotiation solution in equilibrium can be defined and solved by the Nash product.

[0151] Bilateral cooperation with multiple concurrent video receivers:

[0152] The video sender in the live device usually provides video services to a large number of video receivers. The problem is extended to a one-to-many situation, where multiple video receivers negotiate in parallel.

[0153] First, each video receiver independently initiates a content request to the video sender. Any video receiver enjoys video services at a video frame rate f n and provides a resource acquisition consumption parameter p n . For convenience, the frame rate configuration of the video receiver is denoted as F = {f1,..., f n ,..., f N}. The resource acquisition consumption parameter configuration is P = {p1,..., p n ,... p N}. In addition, the symmetry statement should be further extended. The video receiver n provides the resource acquisition consumption parameter p n′ = p n , and obtains the corresponding video frame rate f n′ service.

[0154] Therefore, for the convenience of analysis, any video receiver n is still regarded as an object, except that the configuration of other video receivers of video receiver n is denoted as f -n and p -n The negotiation process mainly includes the following stages.

[0155] Stage 1: Initial step. The video sender provides video content to any video receiver n with normal fixed video frame rate f d The video receiver has no additional service resource consumption.

[0156] Stage 2: Negotiation. Through message negotiation, the video sender and the video receiver can reach an agreement. The video sender determines the optimal video frame rate f for each video receiver, and the corresponding video receiver provides resource acquisition consumption parameter p n . Otherwise, a disagreement occurs, and the service process remains at the fixed video frame rate f d .

[0157] Stage 3: Under the agreement, the video sender and the video receiver respectively implement load reduction while improving the viewing experience.

[0158] Next, the benefit change of negotiation is discussed with video receiver n as an example. For any video receiver n, it simultaneously receives video data segments from N-1 other video receivers from the video sender. The video receiver or the video sender cannot obtain the frame rate decision of other video receivers in advance.

[0159] As shown below:

[0160] Disagreement: The video sender does not reach an agreement with the video receiver n and completes the service at the fixed video frame rate f d . The disagreement point of the video receiver n is 0. The disagreement point of the video sender is the utility increment obtained from other N-1 video receivers. Therefore, the utility improvement of both parties is as shown below:

[0161]

[0162] wherein,

[0163] Agreement:

[0164] Participants determine a solution acceptable to both parties through negotiation and reach an agreement Through the formulation of such an agreement, both parties can achieve their goals.

[0165]

[0166] Improvement: Therefore, the utility increment brought by the agreement can be listed as follows:

[0167]

[0168] The impact of the frame rate adjustment of a single video sink on multiple concurrent video sinks can be measured. According to the following formula:

[0169]

[0170] s.t.ζ n ≥0, Θ(f n )-ζ n ≥0.

[0171] The original Nash product maximization problem can be listed to achieve a Nash negotiation solution:

[0172] maxζ n (Δ Θ -ζ n )

[0173] s.t.Δ Θ -ζ n ≥0, ζ n ≥0

[0174] It can be concluded that the agreement is reached when The video sink n obtains additional effects The video sender shares The resulting resource acquisition consumption parameters will be and For two task executors, in order to achieve this balance, the negotiation solution is as follows:

[0175] (1)

[0176] (2)

[0177] In some embodiments, in step 205, the video transmission utility model is processed by the balancing algorithm to obtain a target transmission strategy corresponding to the maximum value of the video transmission utility model, comprising:

[0178] The controller processes the video transmission utility model based on the reverse induction algorithm to obtain the maximum value of the video transmission utility model according to the following formula:

[0179] maxζ n (Δ Θ -ζ n )

[0180] s.t.Δ Θ -ζn ≥0, ζ n ≥0

[0181] in, This represents the incremental model of received video transmission utility. This represents the incremental model of received video reception utility. This indicates the video frame rate of other video receivers. This indicates the second target video frame rate, and fd represents the second video frame rate parameter. This represents the incremental service utility when multiple video receivers reach a consensus. This represents the incremental service utility when multiple video receivers fail to reach a consensus and continue using the second video frame rate parameter, ζ. n This represents the utility increment at the video receiver.

[0182] The controller determines the second target video frame rate parameter and the second target resource acquisition consumption parameter based on the maximum value of the video transmission utility model, and uses the second target video frame rate parameter and the second target resource acquisition consumption parameter as the target transmission strategy.

[0183] In the above scheme, bilateral cooperation with multiple concurrent video receivers is required:

[0184] Video transmitters typically provide video services to a large number of video receivers in live streaming devices. The problem extends to a one-to-many scenario, where multiple video receivers negotiate in parallel.

[0185] First, each video receiver independently sends a content request to the video sender. Any video receiver... The video receiver uses a video frame rate fn to access video services and provides resource acquisition consumption parameters pn. For convenience, the frame rate configuration at the video receiver is represented as F = {f1, ..., fn}. n , ..., f N The resource acquisition consumption parameters are configured as P = {p1, ..., p}. n , ...p N Furthermore, the symmetry declaration should be extended further. The video receiver n provides the resource acquisition consumption parameter p. n ′=p n To obtain the corresponding video frame rate f n ′ service.

[0186] Therefore, for ease of analysis, any video receiver n should still be treated as an object, and the configuration of other video receivers besides video receiver n is represented as f. -n and p -n The negotiation process mainly includes the following stages.

[0187] Phase 1: Initial step. The video sender sends video content at a normal fixed video frame rate f d The video receiver has no extra service resource consumption.

[0188] Phase 2: Negotiation. Through message negotiation, the video sender and the video receiver can reach an agreement. The video sender determines the best video frame rate f for each video receiver. The corresponding video receiver provides resource acquisition consumption parameter p n . Otherwise, a disagreement occurs, and the service process remains at the fixed video frame rate f d .

[0189] Phase 3: Under the agreement, the video sender and the video receiver respectively implement load reduction while improving the viewing experience.

[0190] Next, the benefit change of negotiation is discussed with the video receiver n as an example. For any video receiver n, it simultaneously receives video data segments from N-1 other video receivers from the video sender. The video receiver or the video sender cannot obtain the frame rate decision of other video receivers in advance.

[0191] As shown below:

[0192] Disagreement: The video sender does not reach an agreement with the video receiver n and completes the service at the fixed video frame rate f d . The disagreement point of the video receiver n is 0. The disagreement point of the video sender is the utility increment obtained from other N-1 video receivers. Therefore, the utility improvement of both parties is as shown below:

[0193]

[0194] wherein,

[0195] Agreement:

[0196] Participants determine a solution acceptable to both parties through negotiation and reach an agreement Through the formulation of such an agreement, both parties can achieve their goals.

[0197]

[0198] Improvement: Therefore, the utility increment brought by the agreement can be listed as follows:

[0199]

[0200] It can help measure the impact of single video receiver frame rate adjustment under multiple concurrent video receivers. According to the following formula:

[0201]

[0202] s.t.ζ n ≥0, Θ(f n )-ζ n ≥0.

[0203] The original Nash product maximization problem can be written to achieve a Nash bargaining solution:

[0204] max ζ1(Δ Θ -ζ n )

[0205] s.t.Δ Θ -ζ n ≥0, ζ n ≥0

[0206] It can be concluded that the agreement is reached at The video receiver n gets the extra effect The video sender shares the effect brought by it. The final resource acquisition consumption parameter will be and For two task executors, in order to achieve this equilibrium, the negotiation solution is as follows:

[0207] (1)

[0208] (2)

[0209] It should be noted that the method of the embodiments of the present application can be executed by a single device, such as a computer or a server, etc. The method of the embodiments can also be applied to a distributed scenario, and completed by multiple devices cooperating with each other. In the case of such a distributed scenario, one of the multiple devices can only execute one or more steps in the method of the embodiments of the present application, and the multiple devices will interact with each other to complete the method.

[0210] It should be noted that some embodiments of the present application have been described above. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recited in the claims can be performed in a different order and still achieve desirable results. Additionally, the processes depicted in the accompanying figures do not necessarily require the particular order shown or sequential order in order to achieve the desired results. In certain implementations, multitasking and parallel processing can be advantageous.

[0211] Corresponding to the method of any of the above embodiments, the application also provides a multi-format video adaptive transmission device based on the same inventive concept.

[0212] Reference Figure 3 The multi-format video adaptive transmission device is arranged in a video adaptive transmission system, the system comprising a controller, a video sending end and at least one video receiving end connected in communication, and the device comprises:

[0213] The video receiving end 301 is configured to acquire resource request parameters, send the resource request parameters to the video sending end, process through a video receiving utility algorithm according to the resource request parameters and received resource configuration parameters, construct a video receiving utility increment model, and send the video receiving utility increment model to the controller.

[0214] The video sending end 302 is configured to determine resource configuration parameters based on the received resource request parameters, send the resource configuration parameters to the video receiving end, process through a video sending utility algorithm according to the resource configuration parameters and received resource request parameters, obtain a video sending utility increment model, and send the video sending utility increment model to the controller.

[0215] The controller 303 is configured to process through a video transmission utility algorithm according to the received video receiving utility increment model and the received video sending utility increment model, construct a video transmission utility model, process the video transmission utility model through a balancing algorithm, obtain a target transmission strategy corresponding to the maximum value of the video transmission utility model, and control the video sending end and the video receiving end to perform a video transmission process according to the target transmission strategy.

[0216] For the convenience of description, the above device is described in various modules according to functions. Of course, the functions of the modules can be implemented in one or more software and / or hardware in the implementation of the application.

[0217] The device of the above embodiments is used to implement the corresponding multi-format video adaptive transmission method of any of the above embodiments, and has the beneficial effects of the corresponding method embodiments, which are not described here again.

[0218] Corresponding to the method of any of the above embodiments, the application also provides an electronic device comprising a memory, a processor and a computer program stored in the memory and executable on the processor, wherein the processor implements the multi-format video adaptive transmission method of any of the above embodiments when executing the program.

[0219] Figure 4A more specific electronic device hardware structure schematic diagram provided by the embodiment is shown. The device can include a processor 401, a memory 402, an input / output interface 403, a communication interface 404, and a bus 405. The processor 401, the memory 402, the input / output interface 403, and the communication interface 404 are connected to each other through the bus 405 for internal communication.

[0220] The processor 401 can be implemented by a general-purpose CPU (Central Processing Unit), a microprocessor, an ASIC (Application Specific Integrated Circuit), or one or more integrated circuits, etc., for executing related programs to implement the technical solutions provided by the embodiments of the present specification.

[0221] The memory 402 can be implemented by a ROM (Read Only Memory), a RAM (Random Access Memory), a static storage device, a dynamic storage device, etc. The memory 402 can store an operating system and other application programs. When the technical solutions provided by the embodiments of the present specification are implemented by software or firmware, the related program codes are stored in the memory 402 and are called and executed by the processor 401.

[0222] The input / output interface 403 is used to connect input / output modules to realize information input and output. The input / output modules can be configured as components in the device (not shown in the figure) or can be externally connected to the device to provide corresponding functions. The input device can include a keyboard, a mouse, a touch screen, a microphone, various sensors, etc., and the output device can include a display, a speaker, a vibrator, an indicator light, etc.

[0223] The communication interface 404 is used to connect a communication module (not shown in the figure) to realize the communication interaction between the device and other devices. The communication module can realize communication through a wired manner (such as USB, network cable, etc.) or through a wireless manner (such as mobile network, WIFI, Bluetooth, etc.).

[0224] The bus 405 includes a channel for transmitting information between various components (such as the processor 401, the memory 402, the input / output interface 403, and the communication interface 404) of the device.

[0225] It should be noted that although the above device only shows the processor 401, the memory 402, the input / output interface 403, the communication interface 404 and the bus 405, in the specific implementation process, the device can also include other components necessary for normal operation. In addition, those skilled in the art can understand that the above device can also only contain the components necessary to implement the embodiments of the present application, and does not necessarily contain all the components shown in the figure.

[0226] The electronic device of the above embodiment is used to implement the corresponding multi-format video adaptive transmission method in any of the preceding embodiments, and has the beneficial effects of the corresponding method embodiments, which are not described here.

[0227] Based on the same inventive concept, corresponding to the method of any of the above embodiments, the present application also provides a non-transitory computer readable storage medium storing computer instructions for causing the computer to perform the multi-format video adaptive transmission method according to any of the above embodiments.

[0228] The computer readable medium of the present embodiment includes permanent and non-permanent, removable and non-removable media, which can be implemented by any method or technology to store information. The information can be computer readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technologies, compact disc read-only memory (CD-ROM), digital versatile disc (DVD) or other optical storage, magnetic cassette, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information that can be accessed by a computing device.

[0229] The computer instructions stored in the storage medium of the above embodiment are used to cause the computer to perform the multi-format video adaptive transmission method according to any of the above embodiments, and have the beneficial effects of the corresponding method embodiments, which are not described here.

[0230] Those skilled in the art should understand that the above discussion of any embodiment is only exemplary and is not intended to limit the scope of the present application to these examples; under the idea of the present application, the above embodiments or technical features in different embodiments can also be combined, the steps can be implemented in any order, and there are many other changes of different aspects of the embodiments of the present application as described above. In order to be brief, they are not provided in detail.

[0231] Additionally, to simplify the description and discussion, and so as not to obscure the embodiments of the application being presented, the well-known functions or constructions of integrated circuit (IC) chips and other components can or can not be shown in the figures and will be omitted as not to unnecessarily obscure the embodiments of the application being presented. Moreover, the devices can be shown in block diagram form in order to avoid unnecessary obscurity of the present embodiments, and this also acknowledges the fact that the details in regard to the implementation of such block diagram devices are highly dependent on the platform within which the present embodiments are to be implemented (i.e., such details should be well within the purview of one of ordinary skill in the art). Where specific details are set forth in order to describe an illustrative embodiment of the application, it will be apparent to one of ordinary skill in the art that the embodiments of the application can be practiced without, or with variation of, these specific details. Thus, the description is to be considered as illustrative and not restrictive, and the scope of the application should be determined not with reference to the above description, but should be given to the appended claims.

[0232] While the present application has been described with respect to a certain specific embodiments thereof, many alternatives, modifications and variations will be apparent to those skilled in the art. For example, other memory architectures (e.g., dynamic RAM (DRAM)) can use the embodiments discussed.

[0233] The embodiments of the present application are intended to cover all such alternatives, modifications and variations as falling within the scope of the present application. Accordingly, any omission, modification, equivalent replacement, improvement, etc. made within the spirit and principle of the embodiments of the present application should be included in the scope of the present application.

Claims

1. A multi-format video adaptive transmission method, characterized in that, Applied to a video adaptive transmission system, the system comprising a controller with communication connections, a video transmitter, and at least one video receiver, the method includes: The video receiving end obtains the resource request parameters and sends the resource request parameters to the video sending end; The video sending end determines the resource configuration parameters based on the received resource request parameters, and sends the resource configuration parameters to the video receiving end; The video receiving end processes the resource request parameters and the received resource configuration parameters using a video receiving utility algorithm to construct a video receiving utility incremental model, and then sends the video receiving utility incremental model to the controller. The video sending end processes the resource configuration parameters and the received resource request parameters using a video sending utility algorithm to obtain a video sending utility incremental model, and then sends the video sending utility incremental model to the controller. The controller processes the received video reception utility increment model and the received video transmission utility increment model using a video transmission utility algorithm to construct a video transmission utility model. It then processes the video transmission utility model using an equalization algorithm to obtain a target transmission strategy corresponding to the maximum value of the video transmission utility model. Based on the target transmission strategy, the controller controls the video transmitter and the video receiver to perform the video transmission process. The resource configuration parameters include: a first resource sending consumption parameter, a first resource receiving consumption parameter, a second resource sending consumption parameter, a second resource receiving consumption parameter, a first video frame rate parameter, and a second video frame rate parameter. The resource request parameters include: a first experience quality parameter, a first resource acquisition consumption parameter, a second experience quality parameter, and a second resource acquisition consumption parameter. The video receiver constructs a first video reception utility model using the following formula: in, This represents the first video reception utility model. This represents the first video frame rate parameter. This indicates the parameter consumed in acquiring the first resource. This indicates the first resource reception consumption parameter. This indicates the primary experience quality parameter. Indicates the weighting factor; The video receiver constructs a second video reception utility model using the following formula: in, This represents the second video reception utility model. This represents the second video frame rate parameter. This indicates the parameter consumed in acquiring the second resource. This indicates the second resource reception consumption parameter. This indicates the second quality parameter of the experience; The video receiver constructs the incremental model of video reception utility using the following formula: ； The video sending end constructs a first video sending utility model using the following formula; in, This represents the first video sending utility model. Indicates the parameter consumed by sending the first resource; The video sending end constructs a second video sending utility model using the following formula; in, This represents the second video transmission utility model. Indicates the parameter consumed by sending the second resource; The video sending end constructs the incremental model of video sending utility using the following formula: ； The controller responds to the video receiver with a quantity of 1, and the video transmission utility model is constructed using the following formula: 。 2. The method according to claim 1, characterized in that, The step of processing the video transmission utility model using an equalization algorithm to obtain the target transmission strategy corresponding to the maximum value of the video transmission utility model includes: The controller processes the video transmission utility model using a backward induction algorithm and the following formula to obtain the maximum value of the video transmission utility model: ； The controller determines the first target video frame rate parameter and the first target resource acquisition consumption parameter based on the maximum value of the video transmission utility model, and uses the target video frame rate parameter and the target resource acquisition consumption parameter as the target transmission strategy.

3. A multi-format video adaptive transmission device, characterized in that, The device is installed in a video adaptive transmission system, the system including a controller with communication connection, a video transmitter and at least one video receiver, and the device performs the method as described in any one of claims 1 to 2.

4. An electronic device comprising a memory, a processor, and a computer program stored in the memory and running on the processor, characterized in that, When the processor executes the program, it implements the method as described in any one of claims 1 to 2.

5. A non-transitory computer-readable storage medium storing computer instructions, characterized in that, The computer instructions are used to cause the computer to perform the method according to any one of claims 1 to 2.

Images