Multi-format video adaptive transmission method and device, electronic equipment and storage medium

Abstract

The invention provides a multi-format video adaptive transmission method and device, electronic equipment and a storage medium, and the method comprises the steps: constructing a video receiving utility increment model through a video receiving end, and obtaining a video sending utility increment model through a video sending end; then, a controller is used for processing through a video transmission utility algorithm according to the received video receiving utility increment model and the received video sending utility increment model, and a video transmission utility model comprehensively considering both the video receiving end and the video sending end is constructed; therefore, the video transmission utility model is processed through a balancing algorithm, and a target transmission strategy for dynamically balancing user watching experience and a video coding and decoding load can be obtained, so that a video sending end and a video receiving end can be controlled according to the target transmission strategy to realize self-adaptive transmission of videos. Therefore, the watching experience can be improved while the load is reduced.

Description

Technical Field

[0001] The present application relates to the field of communication technology, and in particular to a multi-business video adaptive transmission method, device, electronic device and storage medium. Background Art

[0002] The frame rate is the frequency at which bitmap images in frames appear continuously on the display. It determines the smoothness of the video image. Generally, the higher the frame rate, the smoother the video animation effect.

[0003] However, if high frame rate output is maintained for a long time, the load during the transmission process will increase, which is difficult to be supported by resource-constrained mobile terminals. Therefore, how to improve the viewing experience while reducing the load has become a problem that needs to be solved urgently. Summary of the invention

[0004] In view of this, the purpose of the present application is to propose a multi-format video adaptive transmission method, device, electronic device and storage medium to solve the above-mentioned technical problems.

[0005] Based on the above purpose, the first aspect of the present application provides a multi-format video adaptive transmission method, which is applied to a video adaptive transmission system, wherein the system includes a controller, a video transmitting end, and at least one video receiving end connected in communication, and the method includes:

[0006] The video receiving end obtains resource request parameters and sends the resource request parameters to the video sending end;

[0007] The video sending end determines resource configuration parameters based on the received resource request parameters, and sends the resource configuration parameters to the video receiving end;

[0008] The video receiving end processes the resource request parameters and the received resource configuration parameters through a video receiving utility algorithm to construct a video receiving utility increment model, and sends the video receiving utility increment model to the controller;

[0009] The video sending end processes the resource configuration parameters and the received resource request parameters through a video sending utility algorithm to obtain a video sending utility increment model, and sends the video sending utility increment model to the controller;

[0010] The controller processes the received video receiving utility increment model and the received video sending utility increment model through a video transmission utility algorithm to construct a video transmission utility model, and processes the video transmission utility model through an equalization algorithm to obtain a target transmission strategy corresponding to the maximum value of the video transmission utility model, and controls the video sending end and the video receiving end to perform a video transmission process according to the target transmission strategy.

[0011] Based on the same inventive concept, the second aspect of the present application provides a multi-format video adaptive transmission device, the device is arranged in a video adaptive transmission system, the system includes a controller, a video transmitting end and at least one video receiving end connected in communication, the device includes:

[0012] The video receiving end is configured to obtain resource request parameters and send the resource request parameters to the video sending end; process the resource request parameters and the received resource configuration parameters through a video receiving utility algorithm to construct a video receiving utility increment model, and send the video receiving utility increment model to the controller;

[0013] The video sending end is configured to determine resource configuration parameters based on the received resource request parameters, and send the resource configuration parameters to the video receiving end; according to the resource configuration parameters and the received resource request parameters, process them through a video sending utility algorithm to obtain a video sending utility increment model, and send the video sending utility increment model to the controller;

[0014] The controller is configured to process the received video receiving utility increment model and the received video sending utility increment model through a video transmission utility algorithm to construct a video transmission utility model, and to process the video transmission utility model through an equalization algorithm to obtain a target transmission strategy corresponding to the maximum value of the video transmission utility model, and to control the video sending end and the video receiving end to perform a video transmission process according to the target transmission strategy.

[0015] Based on the same inventive concept, the third aspect of the present application provides an electronic device, comprising a memory, a processor, and a computer program stored in the memory and executable by the processor, wherein the processor implements the method described in the first aspect above when executing the computer program.

[0016] Based on the same inventive concept, the fourth aspect of the present application provides a non-transitory computer-readable storage medium, which stores computer instructions, and the computer instructions are used to enable a computer to execute the method described in the first aspect above.

[0017] From the above, it can be seen that the multi-format video adaptive transmission method, device, electronic device and storage medium provided by the present application construct a video reception utility incremental model by processing the video receiving end according to the resource request parameters and the received resource configuration parameters through the video receiving utility algorithm, and use the video sending end to process according to the resource configuration parameters and the received resource request parameters through the video sending utility algorithm to obtain the video sending utility incremental model, and then use the controller to process according to the received video reception utility incremental model and the received video sending utility incremental model through the video transmission utility algorithm to construct a video transmission utility model that comprehensively considers both the video receiving end and the video sending end. Therefore, by processing the video transmission utility model through the balancing algorithm, a target transmission strategy for dynamically balancing the user viewing experience and the video encoding and decoding load can be obtained, so that the video sending end and the video receiving end can be controlled according to such a target transmission strategy to achieve adaptive transmission of the video, thereby achieving improved viewing experience while reducing the load. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] In order to more clearly illustrate the technical solutions in the present application or related technologies, the drawings required for use in the embodiments or related technical descriptions are briefly introduced below. Obviously, the drawings described below are only embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0019] Figure 1 A schematic diagram of a high frame rate video transmission scenario according to an embodiment of the present application;

[0020] Figure 2 This is a flowchart of the multi-format video adaptive transmission method according to an embodiment of the present application;

[0021] Figure 3 This is a structural block diagram of a multi-format video adaptive transmission device according to an embodiment of the present application;

[0022] Figure 4 A schematic diagram of an electronic device according to an embodiment of the present application. DETAILED DESCRIPTION

[0023] In order to make the objectives, technical solutions and advantages of the present application more clearly understood, the present application is further described in detail below in combination with specific embodiments and with reference to the accompanying drawings.

[0024] It should be noted that, unless otherwise defined, the technical terms or scientific terms used in the embodiments of the present application should be the usual meanings understood by people with ordinary skills in the field to which the present application belongs. The "first", "second" and similar words used in the embodiments of the present application do not represent any order, quantity or importance, but are only used to distinguish different components. "Including" or "comprising" and similar words mean that the elements or objects appearing in front of the word cover the elements or objects listed after the word and their equivalents, without excluding other elements or objects. "Connect" or "connected" and similar words are not limited to physical or mechanical connections, but can include electrical connections, whether direct or indirect. "Up", "down", "left", "right" and the like are only used to indicate relative positional relationships. When the absolute position of the described object changes, the relative positional relationship may also change accordingly.

[0025] It is understandable that before using the technical solutions of each embodiment of the present application, the type, scope of use, usage scenarios, etc. of the personal information involved will be informed to the user in an appropriate manner, and the user's authorization will be obtained.

[0026] For example, in response to receiving an active request from a user, a prompt message is sent to the user to clearly remind the user that the operation requested to be performed will require obtaining and using the user's personal information. Thus, the user can independently choose whether to provide personal information to the electronic device, application, server, storage medium or other software or hardware that performs the operation of the technical solution of the present application according to the prompt message.

[0027] As an optional but non-limiting implementation, in response to receiving the user's active request, the prompt information may be sent to the user in the form of a pop-up window, in which the prompt information may be presented in text form. In addition, the pop-up window may also carry a selection control for the user to choose "agree" or "disagree" to provide personal information to the electronic device.

[0028] It is understandable that the above notification and the process of obtaining user authorization are merely illustrative and do not constitute a limitation on the implementation method of this application. Other methods that meet relevant laws and regulations may also be applied to the implementation method of this application.

[0029] Frame rate, as an important UHD video parameter, is often overlooked when performing adaptive video transmission. Compared with other components such as resolution and dynamic range, in general, the frame rate is pre-set and fixed at 30 frames per second (FPS). Sometimes larger values ​​are used, but rarely exceed 60FPS.

[0030] With the advancement of hardware technology, advanced cameras have become more popular, and high frame rate (HFR) videos can be captured and processed more easily. Therefore, a new trend has emerged in the field of video services, and high frame rate videos have entered the daily lives of ordinary people. Intuitively, using high frame rate videos can effectively alleviate motion blur and reduce the spatial displacement between frames when objects move by increasing the number of video frames, such as Figure 1 However, for high-speed motion scenes, hundreds of frames are still required to restore the scene, reproduce the optical reality, and present it to the video receiver in a more realistic way.

[0031] Maintaining a long-term high frame rate output is not simple. On the one hand, a high frame rate may lead to an increase in data traffic. According to the reported measurement, increasing the frame rate from 60FPS to 120FPS will result in an additional increase of more than 41.7% of data. In the test of this application, it was verified that the amount of video data with high spatial information (SI) / temporal information (TI) may be reduced. As the frame rate increases further, this data traffic will grow, thereby increasing the load on the video transmitter and the network during transmission. On the other hand, a high frame rate will generate additional resource consumption. The increase in the number of frames, especially B frames (inter-frame compression algorithm using bidirectional predictive coding) and P frames (a video frame category that compresses the data of this frame according to the difference between this frame and the adjacent previous frame), makes the computing requirements in the video service process greater. For the video transmitter, this is a real-time long-term additional load, and the same is true for each video receiving device, which decodes the received frame data for display. This additional calculation is difficult to be supported by resource-constrained mobile terminals and is difficult to be generally accepted.

[0032] This application considers dynamically adjusting the frame rate of the video to make the playback smoother, and balances the video receiving end experience with the resource consumption for video transmission, establishes a tightly coupled relationship between frame rate control and resource consumption for video transmission, designs a bilateral control strategy for video sender-video receiver negotiation, establishes a closed-loop optimization process of utility feedback, and dynamically balances the user experience and the load for video encoding and decoding.

[0033] The embodiment of the present application provides a multi-format video adaptive transmission method, in which a video receiving end processes resource request parameters and received resource configuration parameters through a video receiving utility algorithm to construct a video receiving utility increment model, and a video sending end processes resource configuration parameters and received resource request parameters through a video sending utility algorithm to obtain a video sending utility increment model, and then a controller processes the received video receiving utility increment model and the received video sending utility increment model through a video transmission utility algorithm to construct a video transmission utility model that comprehensively considers both the video receiving end and the video sending end. Therefore, the video transmission utility model is processed through an equalization algorithm to obtain a target transmission strategy that dynamically balances the user viewing experience and the video encoding and decoding load, so that the video sending end and the video receiving end can be controlled according to such a target transmission strategy to achieve adaptive transmission of the video, thereby achieving improved viewing experience while reducing the load.

[0034] like Figure 2 As shown, it is applied to a video adaptive transmission system, the system includes a controller, a video transmitting end and at least one video receiving end connected in communication, and the method includes:

[0035] Step 201: the video receiving end obtains resource request parameters and sends the resource request parameters to the video sending end.

[0036] In this step, the resource request parameter indicates the resource consumption required for obtaining the video, and the video receiving end indicates the video receiving end device used to watch the video.

[0037] The user watching the video inputs voice or text in the message input area of ​​the conversation window of the video receiving end, and can obtain the resource request parameters after sending.

[0038] Alternatively, different controls for obtaining resource request parameters may be set in the session window of the video receiving end, and the user watching the video may trigger the corresponding control to obtain the resource request parameters according to the needs, or may customize the input in the session window to obtain the resource request parameters.

[0039] Step 202: The video sending end determines resource configuration parameters based on the received resource request parameters, and sends the resource configuration parameters to the video receiving end.

[0040] In this step, the resource configuration parameter is used to measure the display quality of the video. For example, the resource configuration parameter may be a frame rate. The video sender represents a video sending device that encodes real-time streaming media content into high-quality video. The video sender may be a virtualized cloud server.

[0041] Resource request parameters affect resource configuration parameters. The video sender can quickly determine resource configuration parameters based on resource request parameters, such as Figure 1 As shown, a video generator generates real-time streaming media and uploads it to a server. The server (i.e., a video transmitter) encodes the real-time streaming media content to form a video and sends it to a video receiver (Viewer).

[0042] Among them, during the process of video transmission to the video receiving end, the frame rate control (Frame RateControl) of the video can be low frame rate (LOW), medium frame rate (Median), and high frame rate (High), which is determined based on the resource request parameters sent by the video receiving end (Viewer).

[0043] In addition, the frame rate can affect the display quality of the video. For example, a high-frame-rate video has relatively less motion blur (MotionBlur), and the space shift (Space Shift) between two adjacent frames is more coherent. In this way, after the video is transmitted to the terminal (Terminal), that is, transmitted to the video receiving end (i.e., the video receiving end), the user experience (Experience) of the video receiving end will be improved.

[0044] Step 203: The video receiving end processes the resource request parameters and the received resource configuration parameters through a video receiving utility algorithm to construct a video receiving utility increment model, and sends the video receiving utility increment model to the controller.

[0045] In this step, in order to establish bilateral collaboration between the video transmitter and the video receiver and construct a video transmission utility model that comprehensively considers both the video receiver and the video transmitter, the present application quickly constructs a video reception utility incremental model through a video reception utility algorithm.

[0046] Among them, the video reception utility increment model is used to indicate the user experience of the video receiving end.

[0047] Step 204: the video sending end processes the resource configuration parameters and the received resource request parameters through a video sending utility algorithm to obtain a video sending utility increment model, and sends the video sending utility increment model to the controller.

[0048] In this step, in order to establish bilateral collaboration between the video sender and the video receiver and construct a video transmission utility model that comprehensively considers both the video receiver and the video sender, the present application quickly constructs a video transmission utility incremental model through a video transmission utility algorithm.

[0049] The video transmission utility increment model is used to indicate the load used for video encoding and decoding.

[0050] Step 205: The controller processes the received video receiving utility increment model and the received video sending utility increment model through a video transmission utility algorithm to construct a video transmission utility model, and processes the video transmission utility model through an equalization algorithm to obtain a target transmission strategy corresponding to the maximum value of the video transmission utility model, and controls the video sending end and the video receiving end to perform the video transmission process according to the target transmission strategy.

[0051] In this step, bilateral cooperation between the video transmitter and the video receiver is established, and the relationship between the two is balanced based on the incremental model of the video receiving utility of the video receiver and the incremental model of the video sending utility of the video transmitter, rather than unilaterally making a target transmission strategy.

[0052] By processing the video transmission utility model through an equalization algorithm, a target transmission strategy that dynamically balances the user viewing experience and the video encoding and decoding load can be obtained. The video transmitter and the video receiver can be controlled according to such a target transmission strategy to achieve adaptive transmission of the video, thereby improving the viewing experience while reducing the load.

[0053] Through the above scheme, the video receiving end processes the resource request parameters and the received resource configuration parameters through the video receiving utility algorithm to construct a video receiving utility increment model, and the video sending end processes the resource configuration parameters and the received resource request parameters through the video sending utility algorithm to obtain a video sending utility increment model, and then the controller processes the received video receiving utility increment model and the received video sending utility increment model through the video transmission utility algorithm to construct a video transmission utility model that comprehensively considers both the video receiving end and the video sending end. Therefore, the video transmission utility model is processed by the balancing algorithm to obtain a target transmission strategy that dynamically balances the user viewing experience and the video encoding and decoding load, so that the video sending end and the video receiving end can be controlled according to such a target transmission strategy to achieve adaptive transmission of the video, thereby achieving improved viewing experience while reducing the load.

[0054] In some embodiments, the resource configuration parameters include: a first resource reception consumption parameter, a first video frame rate parameter, a second resource reception consumption parameter and a second video frame rate parameter, and the resource request parameters include: a first experience quality parameter, a first resource acquisition consumption parameter, a second experience quality parameter and a second resource acquisition consumption parameter.

[0055] In step 203, the video receiving end processes the resource request parameters and the received resource configuration parameters through a video receiving utility algorithm to construct a video receiving utility increment model, including:

[0056] Step A1: The video receiving end constructs a first video receiving utility model according to the first video frame rate parameter, the first resource acquisition consumption parameter, the first resource reception consumption parameter, the first experience quality parameter and a preset weight factor by using the following formula:

[0057]

[0058] in, represents the first video reception utility model, f * Represents the first video frame rate parameter, p * Indicates the first resource acquisition consumption parameter, c * Indicates the first resource receiving consumption parameter, r * represents the first experience quality parameter, and λ represents the weight factor.

[0059] Step A2: The video receiving end constructs a second video receiving utility model according to the second video frame rate parameter, the second resource acquisition consumption parameter, the second resource reception consumption parameter, the second experience quality parameter and a preset weight factor by using the following formula:

[0060]

[0061] in, represents the second video receiving utility model, fd represents the second video frame rate parameter, p d Indicates the consumption parameter of the second resource acquisition, c d Indicates the second resource receiving consumption parameter, r d represents the second experience quality parameter, and λ represents the weight factor.

[0062] Step A3: The video receiving end constructs the video receiving utility increment model based on the first video receiving utility model and the second video receiving utility model by using the following formula:

[0063]

[0064] in, Q*(f*)=(r*-c*)·f*

[0065] Q d (f d )=(r d -c d )·f d , λ represents the weight factor, f* Represents the first video frame rate parameter, p * Indicates the first resource acquisition consumption parameter, f d Indicates the second video frame rate parameter, represents the first video reception utility model, represents the second video receiving utility model, p d Indicates the second resource acquisition consumption parameter, p d is 0, c * Indicates the first resource receiving consumption parameter, f * represents the first experience quality parameter, c d Indicates the second resource receiving consumption parameter, r d represents a second experience quality parameter.

[0066] In the above scheme, it is assumed that the initial fixed video frame rate is f d (i.e., the second video frame rate parameter), the video receiving end can receive the video at the frame rate f without using the resource request parameter. d Enjoy videos without extra resource consumption.

[0067] Let f n represents the viewing frame rate of the video receiver n. After receiving a video frame, the average unit frame loss c used to decode and display the frame n (i.e., resource reception consumption parameter) is consumed. In this process, the video receiving end n obtains a smooth viewing experience from the frame. The resulting experience quality parameter r n (i.e., QoE) is the consumption of p by the video receiving end n n As a resource request parameter of the frame rate, the utility of the video receiving end n is expressed as follows:

[0068]

[0069] Where λ is the weight factor. For convenience, let Q n (f n )=(r n -c n )·f n Therefore, the frame rate changes, and the corresponding Q n (f n )=(r n -c n )·f n Instead, by comparing it with the fixed video frame rate f d For comparison, an incremental model of video reception utility is introduced.

[0070]

[0071] Among them, K n(f n )=Q n (f n )-Q d (f d )

[0072] That is, the video receiving end constructs a first video receiving utility model through the following formula according to the first video frame rate parameter, the first resource acquisition consumption parameter, the first resource reception consumption parameter, the first experience quality parameter and a preset weight factor:

[0073]

[0074] in, represents the first video receiving utility model, f* represents the first video frame rate parameter, p * Indicates the first resource acquisition consumption parameter, c * Indicates the first resource receiving consumption parameter, f * represents the first experience quality parameter, λ represents the weight factor;

[0075] The video receiving end constructs a second video receiving utility model by the following formula according to the second video frame rate parameter, the second resource acquisition consumption parameter, the second resource reception consumption parameter, the second experience quality parameter and a preset weight factor:

[0076]

[0077] in, represents the second video receiving utility model, fd represents the second video frame rate parameter, p d Indicates the consumption parameter of the second resource acquisition, c d Indicates the second resource receiving consumption parameter, r d represents the second experience quality parameter, λ represents the weight factor;

[0078] The video receiving end constructs the video receiving utility increment model based on the first video receiving utility model and the second video receiving utility model by using the following formula:

[0079]

[0080] in, Q*(f*)=(r*-c*)·f*

[0081] Q d (f d )=(r d -c d )·f d , λ represents the weight factor, f *Represents the first video frame rate parameter, p * Indicates the first resource acquisition consumption parameter, f d Indicates the second video frame rate parameter, represents the first video reception utility model, represents the second video receiving utility model, pd represents the second resource acquisition consumption parameter, p d is 0, c * Indicates the first resource receiving consumption parameter, r * represents the first experience quality parameter, c d Indicates the second resource receiving consumption parameter, r d represents a second experience quality parameter.

[0082] In some embodiments, the resource configuration parameters include: a first resource sending consumption parameter, a first video frame rate parameter, a second resource sending consumption parameter and a second video frame rate parameter, and the resource request parameters include: a first resource acquisition consumption parameter and a second resource acquisition consumption parameter.

[0083] In step 204, the video transmitter processes the resource configuration parameters and the received resource request parameters through a video transmission utility algorithm to obtain a video transmission utility increment model, including:

[0084] Step B1, the video sending end constructs a first video sending utility model through the following formula according to the first video frame rate parameter, the first resource acquisition consumption parameter, a preset weight factor and the first resource sending utility parameter;

[0085]

[0086] in, represents the first video sending utility model, f* represents the first video frame rate parameter, p * represents the first resource acquisition consumption parameter, λ represents the weight factor, C(f * ) indicates that the first resource sends consumption parameters.

[0087] Step B2, the video sending end constructs a second video sending utility model by the following formula according to the second video frame rate parameter, the second resource acquisition consumption parameter, a preset weight factor and the second resource sending utility parameter;

[0088]

[0089] in, represents the second video sending utility model, fd represents the second video frame rate parameter, p d represents the second resource acquisition consumption parameter, λ represents the weight factor, C(f d) indicates that the second resource sends consumption parameters.

[0090] Step B3: The video sending end constructs the video sending utility increment model by the following formula based on the first video sending utility model and the second video sending utility model:

[0091]

[0092] in, represents the incremental model of video sending utility, represents the first video sending utility model, represents the second video sending utility model, λ represents the weight factor, and f * Represents the first video frame rate parameter, p * Indicates the first resource acquisition consumption parameter, f d represents the second video frame rate parameter, pd represents the second resource acquisition consumption parameter, p d is 0, C(f * ) represents the first resource sending consumption parameter, C(f d ) indicates that the second resource sends consumption parameters.

[0093] In the above scheme, the cloud server plays the role of the video sender as the video sender. It transmits the video at a frame rate of f n (including fixed video frame rate f d ) encodes and transmits video content, generating video frame rate parameter C(f n ), which includes computing resources, transmission delays, etc.

[0094] According to the experimental results, the consumption is proportional to the frame rate. In this application, it is regarded as a monotonically increasing convex function, and the video transmitter provides comprehensive content services for any video receiver n. The resource acquisition consumption parameter p of the video receiver n is n The video sending utility model of the video sending end can be expressed as follows:

[0095]

[0096] Similarly, as the frame rate changes, the video sending utility model will also adjust. For a fixed video frame rate f d For video services, the video sending utility model is expressed as follows:

[0097]

[0098] Among them, H n (f n )=c(f n )+C(f d).

[0099] That is, the video sending end constructs a first video sending utility model through the following formula according to the first video frame rate parameter, the first resource acquisition consumption parameter, the preset weight factor and the first resource sending utility parameter;

[0100]

[0101] in, represents the first video sending utility model, f * Indicates the first video frame rate parameter, p * represents the first resource acquisition consumption parameter, λ represents the weight factor, C(f * ) represents the first resource sending consumption parameter;

[0102] The video sending end constructs a second video sending utility model by the following formula according to the second video frame rate parameter, the second resource acquisition consumption parameter, a preset weight factor and the second resource sending utility parameter;

[0103]

[0104] in, represents the second video sending utility model, fd represents the second video frame rate parameter, p d represents the second resource acquisition consumption parameter, λ represents the weight factor, C(f d ) indicates that the second resource sends a consumption parameter;

[0105] The video sending end constructs the video sending utility increment model based on the first video sending utility model and the second video sending utility model by using the following formula:

[0106]

[0107] in, represents the incremental model of video sending utility, represents the first video sending utility model, represents the second video sending utility model, λ represents the weight factor, and f * Represents the first video frame rate parameter, p * Indicates the first resource acquisition consumption parameter, f d Represents the second video frame rate parameter, p d Indicates the second resource acquisition consumption parameter, p d is 0, C(f * ) represents the first resource sending consumption parameter, C(f d ) indicates that the second resource sends consumption parameters.

[0108] In some embodiments, in step 205, the controller processes the received video receiving utility increment model and the received video sending utility increment model through a video transmission utility algorithm to construct a video transmission utility model, including:

[0109] In response to the number of the video receiving terminals being 1, the controller constructs the video transmission utility model according to the received video reception utility increment model and the received video transmission utility increment model by using the following formula:

[0110]

[0111] in, represents the incremental model of the received video sending utility, represents the first video sending utility model, represents the second video sending utility model, f * Represents the first video frame rate parameter, p * Indicates the first resource acquisition consumption parameter, f d represents the second video frame rate parameter, pd represents the second resource acquisition consumption parameter, represents the incremental model of the received video reception utility, represents the first video reception utility model, Represents a second video reception utility model.

[0112] In the above scheme, the intended purpose is to improve the viewing experience while reducing the load, that is, maintaining the overall interest of the video service process, which is the optimization goal.

[0113] The optimization objective is used to describe the total sum of the incremental model of the video receiving utility of the video receiving end and the incremental model of the video sending utility of the video sending end during the entire video service process, and is defined as follows:

[0114]

[0115] Adaptive transmission based on bilateral negotiation:

[0116] As the optimization goal shown above, the intended purpose is to establish a balance between video frame rate and resource acquisition consumption parameters in a dynamic external environment. As participants in the video service, the video sender and the video receiver have different tendencies and influence each other. Changes in one party can directly affect the other party, which makes cooperative control of the frame rate more difficult. This application negotiates through a cooperative framework that can establish connections between participants and reach consensus on decisions to optimize their respective purposes. It provides a feasible idea for solving existing problems.

[0117] First create a negotiation task It includes two task executors, namely the video sender S and the video receiver v. When the two task executors reach an agreement on the balance between the video frame rate and the resource acquisition consumption parameters through negotiation, an agreement a=(f n , p n ).make and They are the video frame rate f n and resource acquisition consumption parameter p n The negotiation results of any agreement constitute the available space On the other hand, the negotiation may fail to meet the expectations of both participants, resulting in a disagreement D. The parties should not adjust their measurements and the situation will remain unchanged. For convenience, the optional feasible regions of the parties are expressed as Then, both parties will gain from the cooperation As a result, the ultimate goal is to achieve a Nash equilibrium without any changes in the external environment, and no task performer has an incentive to change the agreement. A unique negotiation equilibrium exists if the following four conditions are met, such as Pareto efficiency, symmetry, invariance to affine transformations, and independence from irrelevant alternatives.

[0118] The utility of the task performer is monotonically increasing and convex. The Nash negotiation solution in equilibrium can be defined and solved by the Nash product.

[0119] The Nash Bargaining Solution (NBS) can be achieved by using the optimal protocol a * ={f * , p *} obtain, obtain utility for both task executors If the following Nash product is maximized.

[0120]

[0121] in, and They are the utilities in the case of disagreement, respectively. It can be seen that the elements in the Nash product are composed of the incremental model of the video reception utility and the incremental model of the video reception utility of both parties in the agreement.

[0122] Therefore, the Nash negotiation solution is expected to reach an agreement among the participants as much as possible to improve the value of the video transmission utility model, rather than maintain disagreement.

[0123] The following is a bilateral collaboration with a single video sink that satisfies the above four axioms such as Pareto efficiency, symmetry, invariance to affine transformations, and independence from irrelevant alternatives.

[0124] The scenario includes a video sender and a video receiver. In this case, in a one-to-one situation, the video sender provides a comprehensive video service to a single video receiver. Let the single video receiver be video receiver n. The agreement reached between the task performers is represented as a n ={f n , p n}.

[0125] according to and The original Nash product can be derived as follows:

[0126]

[0127] in, represents the first video sending utility model, represents the second video sending utility model, represents the first video reception utility model, represents the second video reception utility model, f * Represents the first video frame rate parameter, p * Indicates the first resource acquisition consumption parameter, f d Represents the second video frame rate parameter, p d Indicates the second resource acquisition consumption parameter, p d is 0, Q * (f * )=(r * -c * )·f * Q d (f d )=(r d -c d )·f d , c * Indicates the first resource receiving consumption parameter, r * represents the first experience quality parameter, c d Indicates the second resource receiving consumption parameter, r d represents the second experience quality parameter, C(f * ) represents the first resource sending consumption parameter, C(f d ) indicates that the second resource sends a consumption parameter;

[0128] The controller determines a first target video frame rate parameter and a first target resource acquisition consumption parameter based on a maximum value of the video transmission utility model, and uses the target video frame rate parameter and the target resource acquisition consumption parameter as the target transmission strategy.

[0129] In some embodiments, in step 205, the video transmission utility model is processed by a balancing algorithm to obtain a target transmission strategy corresponding to a maximum value of the video transmission utility model, including:

[0130] Step C1, the controller processes the video transmission utility model based on a reverse induction algorithm by using the following formula to obtain a maximum value of the video transmission utility model:

[0131]

[0132] in, represents the first video sending utility model, represents the second video sending utility model, represents the first video reception utility model, represents the second video reception utility model, f * Represents the first video frame rate parameter, p * Indicates the first resource acquisition consumption parameter, f d Represents the second video frame rate parameter, p d Indicates the second resource acquisition consumption parameter, p d is 0, Q * (f * )=(r * -c * )·f * Q d (f d )=(r d -c d )·f d , c * Indicates the first resource receiving consumption parameter, r * represents the first experience quality parameter, c d Indicates the second resource receiving consumption parameter, r d represents the second experience quality parameter, C(f * ) represents the first resource sending consumption parameter, C(f d ) indicates that the second resource sends consumption parameters.

[0133] In step C2, the controller determines a first target video frame rate parameter and a first target resource acquisition consumption parameter based on a maximum value of the video transmission utility model, and uses the target video frame rate parameter and the target resource acquisition consumption parameter as the target transmission strategy.

[0134] In the above scheme, the following is a bilateral cooperation with a single video receiver, satisfying the above four axioms such as Pareto efficiency, symmetry, invariance to affine transformations, and independence from irrelevant alternatives.

[0135] The scenario includes a video sender and a video receiver. In this case, in a one-to-one situation, the video sender provides a comprehensive video service to a single video receiver. Let the single video receiver be video receiver n. The agreement reached between the task performers is represented as a n ={f n , p n}.

[0136] according to and The original Nash product can be derived as follows:

[0137]

[0138] Equation (A) is given by the formula and Derived from, equation (B) comes from the formula Equation (C) introduces ζ n =K n -p n Obviously, this is a strictly convex quadratic function. When the optimal When the corresponding video frame rate and resource acquisition consumption parameters Can also be generated.

[0139] In order to derive the optimal solution, the reverse induction method is introduced. First, consider any given video frame rate By solving the convex optimization problem, we can obtain the optimal Secondly, the best Substituted into the formula The original problem can be transformed into about f n Function: This is equivalent to maximizing Θ(f n ),Right now Nash negotiation solution and Θ(f n ) maximization shows that each participant can only obtain the maximum value of the incremental model of video reception utility and the maximum value of the incremental model of video reception utility by achieving the maximum overall utility. This is because the transferable utility of both parties, specifically the resource acquisition consumption parameter p n .

[0140] In some embodiments, in step 205, the controller processes the received video receiving utility increment model and the received video sending utility increment model through a video transmission utility algorithm to construct a video transmission utility model, including:

[0141] In response to the number of the video receiving terminals being greater than or equal to 2, the controller constructs the video transmission utility model according to the received video reception utility increment model and the received video transmission utility increment model by using the following formula:

[0142] ( n (Δ Θ -ζ n )

[0143] in, represents the incremental model of the received video sending utility, represents the incremental model of the received video reception utility, Indicates the video frame rate of other video receivers. represents the second target video frame rate, fd represents the second video frame rate parameter, It represents the incremental service utility when multiple video receivers reach a consensus. Indicates the service utility increment when multiple video receiving ends fail to reach a consensus and still use the second video frame rate parameter, ζ n Represents the utility increment of the video receiver.

[0144] In the above scheme, the intended purpose is to improve the viewing experience while reducing the load, that is, maintaining the overall interest of the video service process, which is the optimization goal.

[0145] The optimization objective is used to describe the total sum of the incremental model of the video receiving utility of the video receiving end and the incremental model of the video sending utility of the video sending end during the entire video service process, and is defined as follows:

[0146]

[0147] Adaptive transmission based on bilateral negotiation:

[0148] As the optimization goal shown above, the intended purpose is to establish a balance between video frame rate and resource acquisition consumption parameters in a dynamic external environment. As participants in the video service, the video sender and the video receiver have different tendencies and influence each other. Changes in one party can directly affect the other party, which makes cooperative control of the frame rate more difficult. This application negotiates through a cooperative framework that can establish connections between participants and reach consensus on decisions to optimize their respective purposes. It provides a feasible idea for solving existing problems.

[0149] First create a negotiation task It includes two task executors, namely the video sender S and the video receiver When two task executors reach an agreement on the balance between the video frame rate and resource acquisition consumption parameters through negotiation, an agreement a = (f n , p n ).make and They are the video frame rate f n and resource acquisition consumption parameter p n The negotiation results of any agreement constitute the available space On the other hand, the negotiation may fail to meet the expectations of both participants, resulting in a disagreement D. The parties should not adjust their measurements and the situation will remain unchanged. For convenience, the optional feasible regions of the parties are expressed as Then, both parties will gain from the cooperation As a result, the ultimate goal is to achieve a Nash equilibrium without any changes in the external environment, and no task performer has an incentive to change the agreement. A unique negotiation equilibrium exists if the following four conditions are met, such as Pareto efficiency, symmetry, invariance to affine transformations, and independence from irrelevant alternatives.

[0150] The utility of the task performer is monotonically increasing and convex. The Nash negotiation solution in equilibrium can be defined and solved by the Nash product.

[0151] Bilateral collaboration with multiple concurrent video receivers:

[0152] The video transmitter in a live broadcast device usually provides video services to a large number of video receivers. The problem extends to a one-to-many situation, where multiple video receivers negotiate in parallel.

[0153] First, each video receiver independently initiates a content request to the video sender. At video frame rate f n Enjoy the video service and provide resource acquisition consumption parameters p n For convenience, the frame rate configuration of the video receiving end is expressed as F = {f 1 , ..., f n , ..., f N}. Resource acquisition consumption parameter configuration is P = {p 1 ,…,p n ,…p N}. In addition, the symmetry statement should be further extended. The video receiver n provides resource acquisition consumption parameters p n′ =p n , get the corresponding video frame rate fn′ services.

[0154] Therefore, for the convenience of analysis, any video sink n still needs to be regarded as an object, and the configuration of other video sinks except video sink n is represented as f -n and p -n The negotiation process mainly includes the following stages.

[0155] Phase 1: Initial step. The video transmitter uses a normal fixed video frame rate f d Provide video content to any video receiving end n without consuming any additional service resources.

[0156] Phase 2: Negotiation. Through message negotiation, the video sender and the video receiver can reach an agreement. The video sender determines the optimal video frame rate for each video receiver. The corresponding video receiving end provides resource acquisition consumption parameter p n Otherwise, a disagreement occurs and the service process uses a fixed video frame rate f d Keep.

[0157] Phase 3: Under the protocol, the video sender and the video receiver respectively reduce the load while improving the viewing experience.

[0158] Next, we discuss the changes in the interests of the negotiation by taking the video receiving end n as a representative. For any video receiving end n, it simultaneously receives video data segments from N-1 other video receiving ends from the video sending end. The video receiving end or the video sending end cannot obtain the frame rate decision of other video receiving ends in advance.

[0159] As shown below:

[0160] Disagreement: The video sender does not reach an agreement with the video receiver n and uses a fixed video frame rate f d The service is completed. The divergence point of the video receiver n is 0. The divergence point of the video sender is the utility increment it obtains from the other N-1 video receivers. Therefore, the utility improvement of both parties is as follows:

[0161]

[0162] in,

[0163] protocol:

[0164] The participants negotiate to find a solution acceptable to both parties and reach an agreement Through the formulation of this agreement, both parties can achieve their goals.

[0165]

[0166] Improvements: Therefore, the utility increments brought by the protocol can be listed as follows:

[0167]

[0168] It can help measure the impact of adjusting the frame rate of a single video receiver under multiple concurrent video receivers. According to the following formula:

[0169]

[0170] st n ≥0,Θ(f n )-ζ n ≥0.

[0171] The original Nash product maximization problem can be formulated to achieve a Nash bargaining solution:

[0172] maxζ n (Δ Θ -ζ n )

[0173] stΔ Θ -ζ n ≥0,ζ n ≥0

[0174] It can be concluded that the agreement The video receiving end n obtains additional effects Video sender sharing The final resource acquisition consumption parameter will be and For two task executors, in order to achieve this equilibrium, the negotiation solution is as follows:

[0175] (1)

[0176] (2)

[0177] In some embodiments, in step 205, the video transmission utility model is processed by a balancing algorithm to obtain a target transmission strategy corresponding to a maximum value of the video transmission utility model, including:

[0178] The controller processes the video transmission utility model based on the reverse induction algorithm through the following formula to obtain the maximum value of the video transmission utility model:

[0179] maxζ n (Δ Θ -ζ n )

[0180] stΔ Θ -ζ n ≥0,ζ n ≥0

[0181] in, represents the incremental model of the received video sending utility, represents the incremental model of the received video reception utility, Indicates the video frame rate of other video receivers. represents the second target video frame rate, fd represents the second video frame rate parameter, It represents the incremental service utility when multiple video receivers reach a consensus. Indicates the service utility increment when multiple video receiving ends fail to reach a consensus and still use the second video frame rate parameter, ζ n represents the utility increment of the video receiver;

[0182] The controller determines a second target video frame rate parameter and a second target resource acquisition consumption parameter based on the maximum value of the video transmission utility model, and uses the second target video frame rate parameter and the second target resource acquisition consumption parameter as the target transmission strategy.

[0183] In the above scenario, bilateral cooperation with multiple concurrent video receivers:

[0184] The video transmitter in a live broadcast device usually provides video services to a large number of video receivers. The problem extends to a one-to-many situation, where multiple video receivers negotiate in parallel.

[0185] First, each video receiver independently initiates a content request to the video sender. Enjoy the video service at the video frame rate fn and provide the resource acquisition consumption parameter pn. For convenience, the frame rate configuration of the video receiving end is expressed as F = {f 1 , ..., f n , …, f N}. Resource acquisition consumption parameter configuration is P = {p 1 , ..., p n ,…p N}. In addition, the symmetry statement should be further extended. The video receiver n provides resource acquisition consumption parameters p n ′=p n , get the corresponding video frame rate f n ′ service.

[0186] Therefore, for the convenience of analysis, any video sink n still needs to be regarded as an object, and the configuration of other video sinks except video sink n is represented as f-n and p -n The negotiation process mainly includes the following stages.

[0187] Phase 1: Initial step. The video transmitter uses a normal fixed video frame rate f d Provide video content to any video receiving end n without consuming any additional service resources.

[0188] Phase 2: Negotiation. Through message negotiation, the video sender and the video receiver can reach an agreement. The video sender determines the optimal video frame rate for each video receiver. The corresponding video receiving end provides resource acquisition consumption parameter p n Otherwise, a disagreement occurs and the service process uses a fixed video frame rate f d Keep.

[0189] Phase 3: Under the protocol, the video sender and the video receiver respectively reduce the load while improving the viewing experience.

[0190] Next, we discuss the changes in the interests of the negotiation by taking the video receiving end n as a representative. For any video receiving end n, it simultaneously receives video data segments from N-1 other video receiving ends from the video sending end. The video receiving end or the video sending end cannot obtain the frame rate decision of other video receiving ends in advance.

[0191] As shown below:

[0192] Disagreement: The video sender does not reach an agreement with the video receiver n and uses a fixed video frame rate f d The service is completed. The divergence point of the video receiver n is 0. The divergence point of the video sender is the utility increment it obtains from the other N-1 video receivers. Therefore, the utility improvement of both parties is as follows:

[0193]

[0194] in,

[0195] protocol:

[0196] The participants negotiate to find a solution acceptable to both parties and reach an agreement Through the formulation of this agreement, both parties can achieve their goals.

[0197]

[0198] Improvements: Therefore, the utility increments brought by the protocol can be listed as follows:

[0199]

[0200] It can help measure the impact of adjusting the frame rate of a single video receiver under multiple concurrent video receivers. According to the following formula:

[0201]

[0202] st n ≥0,Θ(f n )-ζ n ≥0.

[0203] The original Nash product maximization problem can be formulated to achieve a Nash bargaining solution:

[0204] maxζ 1 (Δ Θ -ζ n )

[0205] stΔ Θ -ζ n ≥0,ζ n ≥0

[0206] It can be concluded that the agreement The video receiving end n obtains additional effects Video sender sharing The final resource acquisition consumption parameter will be and For two task executors, in order to achieve this equilibrium, the negotiation solution is as follows:

[0207] (1)

[0208] (2)

[0209] It should be noted that the method of the embodiment of the present application can be performed by a single device, such as a computer or server. The method of this embodiment can also be applied to a distributed scenario and completed by multiple devices cooperating with each other. In the case of such a distributed scenario, one of the multiple devices can only perform one or more steps in the method of the embodiment of the present application, and the multiple devices will interact with each other to complete the described method.

[0210] It should be noted that the above describes some embodiments of the present application. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recorded in the claims can be performed in an order different from that in the above embodiments and still achieve the desired results. In addition, the processes depicted in the accompanying drawings do not necessarily require the specific order or continuous order shown to achieve the desired results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.

[0211] Based on the same inventive concept, corresponding to any of the above-mentioned embodiment methods, the present application also provides a multi-format video adaptive transmission device.

[0212] refer to Figure 3 , the multi-format video adaptive transmission device, the device is arranged in a video adaptive transmission system, the system includes a controller, a video transmitting end and at least one video receiving end connected in communication, the device includes:

[0213] The video receiving end 301 is configured to obtain resource request parameters and send the resource request parameters to the video sending end; process the resource request parameters and the received resource configuration parameters through a video receiving utility algorithm to construct a video receiving utility increment model, and send the video receiving utility increment model to the controller;

[0214] The video sending end 302 is configured to determine resource configuration parameters based on the received resource request parameters, and send the resource configuration parameters to the video receiving end; according to the resource configuration parameters and the received resource request parameters, process them through a video sending utility algorithm to obtain a video sending utility increment model, and send the video sending utility increment model to the controller;

[0215] The controller 303 is configured to process the received video receiving utility increment model and the received video sending utility increment model through a video transmission utility algorithm to construct a video transmission utility model, and to process the video transmission utility model through an equalization algorithm to obtain a target transmission strategy corresponding to the maximum value of the video transmission utility model, and to control the video sending end and the video receiving end to perform the video transmission process according to the target transmission strategy.

[0216] For the convenience of description, the above device is described in terms of functions divided into various modules. Of course, when implementing the present application, the functions of each module can be implemented in the same or multiple software and / or hardware.

[0217] The device of the above embodiment is used to implement the corresponding multi-business video adaptive transmission method in any of the above embodiments, and has the beneficial effects of the corresponding method embodiment, which will not be repeated here.

[0218] Based on the same inventive concept, corresponding to any of the above-mentioned embodiments and methods, the present application also provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the program, the multi-format video adaptive transmission method described in any of the above embodiments is implemented.

[0219] Figure 4 A more specific schematic diagram of the hardware structure of an electronic device provided in this embodiment is shown, and the device may include: a processor 401, a memory 402, an input / output interface 403, a communication interface 404, and a bus 405. The processor 401, the memory 402, the input / output interface 403, and the communication interface 404 are connected to each other in communication within the device through the bus 405.

[0220] The processor 401 can be implemented by a general-purpose CPU (Central Processing Unit), a microprocessor, an application-specific integrated circuit (ASIC), or one or more integrated circuits, and is used to execute relevant programs to implement the technical solutions provided in the embodiments of this specification.

[0221] The memory 402 can be implemented in the form of ROM (Read Only Memory), RAM (Random Access Memory), static storage device, dynamic storage device, etc. The memory 402 can store an operating system and other application programs. When the technical solutions provided in the embodiments of this specification are implemented by software or firmware, the relevant program codes are stored in the memory 402 and called and executed by the processor 401.

[0222] The input / output interface 403 is used to connect the input / output module to realize information input and output. The input / output module can be configured in the device as a component (not shown in the figure), or it can be externally connected to the device to provide corresponding functions. The input device may include a keyboard, a mouse, a touch screen, a microphone, various sensors, etc., and the output device may include a display, a speaker, a vibrator, an indicator light, etc.

[0223] The communication interface 404 is used to connect a communication module (not shown) to realize communication interaction between the device and other devices. The communication module can realize communication through a wired mode (such as USB, network cable, etc.) or a wireless mode (such as mobile network, WIFI, Bluetooth, etc.).

[0224] The bus 405 comprises a pathway for transmitting information between the various components of the device (eg, the processor 401 , the memory 402 , the input / output interface 403 , and the communication interface 404 ).

[0225] It should be noted that, although the above device only shows the processor 401, the memory 402, the input / output interface 403, the communication interface 404 and the bus 405, in the specific implementation process, the device may also include other components necessary for normal operation. In addition, it can be understood by those skilled in the art that the above device may also only include the components necessary for implementing the embodiments of the present specification, and does not necessarily include all the components shown in the figure.

[0226] The electronic device of the above embodiment is used to implement the corresponding multi-format video adaptive transmission method in any of the above embodiments, and has the beneficial effects of the corresponding method embodiment, which will not be repeated here.

[0227] Based on the same inventive concept, corresponding to any of the above-mentioned embodiment methods, the present application also provides a non-transitory computer-readable storage medium, wherein the non-transitory computer-readable storage medium stores computer instructions, and the computer instructions are used to enable the computer to execute the multi-business video adaptive transmission method described in any of the above embodiments.

[0228] The computer-readable medium of this embodiment includes permanent and non-permanent, removable and non-removable media, and information storage can be implemented by any method or technology. Information can be computer-readable instructions, data structures, modules of programs, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, read-only compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device.

[0229] The computer instructions stored in the storage medium of the above embodiment are used to enable the computer to execute the multi-format video adaptive transmission method as described in any of the above embodiments, and have the beneficial effects of the corresponding method embodiments, which will not be repeated here.

[0230] A person skilled in the art should understand that the discussion of any of the above embodiments is merely illustrative and is not intended to imply that the scope of the present application is limited to these examples. In line with the concept of the present application, the technical features in the above embodiments or different embodiments may be combined, the steps may be implemented in any order, and there are many other variations of the different aspects of the embodiments of the present application as described above, which are not provided in detail for the sake of simplicity.

[0231] In addition, to simplify the description and discussion, and in order not to make the embodiments of the present application difficult to understand, the known power supply / ground connection with the integrated circuit (IC) chip and other components may or may not be shown in the provided drawings. In addition, the device can be shown in the form of a block diagram to avoid making the embodiments of the present application difficult to understand, and this also takes into account the fact that the details of the implementation of these block diagram devices are highly dependent on the platform to be implemented in the embodiments of the present application (that is, these details should be fully within the scope of understanding of those skilled in the art). In the case of elaborating specific details (e.g., circuits) to describe exemplary embodiments of the present application, it is obvious to those skilled in the art that the embodiments of the present application can be implemented without these specific details or when these specific details are changed. Therefore, these descriptions should be considered to be illustrative rather than restrictive.

[0232] Although the present application has been described in conjunction with specific embodiments of the present application, many replacements, modifications and variations of these embodiments will be apparent to those skilled in the art from the foregoing description. For example, other memory architectures (e.g., dynamic RAM (DRAM)) may use the embodiments discussed.

[0233] The embodiments of the present application are intended to cover all such substitutions, modifications and variations that fall within the broad scope of the present application. Therefore, any omissions, modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the embodiments of the present application should be included in the protection scope of the present application.

Claims

1. A multi-format video adaptive transmission method, characterized in that: Applied to a video adaptive transmission system, the system includes a controller, a video transmitter and at least one video receiver connected in communication, the method includes: The video receiving end obtains resource request parameters and sends the resource request parameters to the video sending end; The video sending end determines resource configuration parameters based on the received resource request parameters, and sends the resource configuration parameters to the video receiving end; The video receiving end processes the resource request parameters and the received resource configuration parameters through a video receiving utility algorithm to construct a video receiving utility increment model, and sends the video receiving utility increment model to the controller; The video sending end processes the resource configuration parameters and the received resource request parameters through a video sending utility algorithm to obtain a video sending utility increment model, and sends the video sending utility increment model to the controller; The controller processes the received video receiving utility increment model and the received video sending utility increment model through a video transmission utility algorithm to construct a video transmission utility model, and processes the video transmission utility model through an equalization algorithm to obtain a target transmission strategy corresponding to the maximum value of the video transmission utility model, and controls the video sending end and the video receiving end to perform a video transmission process according to the target transmission strategy.

2. The method according to claim 1, characterized in that The resource configuration parameters include: a first resource reception consumption parameter, a first video frame rate parameter, a second resource reception consumption parameter, and a second video frame rate parameter; the resource request parameters include: a first experience quality parameter, a first resource acquisition consumption parameter, a second experience quality parameter, and a second resource acquisition consumption parameter; The video receiving end processes the resource request parameters and the received resource configuration parameters through a video receiving utility algorithm to construct a video receiving utility increment model, including: The video receiving end constructs a first video receiving utility model by using the following formula according to the first video frame rate parameter, the first resource acquisition consumption parameter, the first resource reception consumption parameter, the first experience quality parameter and a preset weight factor: in, represents the first video reception utility model, f * Represents the first video frame rate parameter, p * Indicates the first resource acquisition consumption parameter, c * Indicates the first resource receiving consumption parameter, r * represents the first experience quality parameter, λ represents the weight factor; The video receiving end constructs a second video receiving utility model by the following formula according to the second video frame rate parameter, the second resource acquisition consumption parameter, the second resource reception consumption parameter, the second experience quality parameter and a preset weight factor: in, represents the second video reception utility model, f d Represents the second video frame rate parameter, p d Indicates the consumption parameter of the second resource acquisition, c d Indicates the second resource receiving consumption parameter, r d represents the second experience quality parameter, λ represents the weight factor; The video receiving end constructs the video receiving utility increment model based on the first video receiving utility model and the second video receiving utility model by using the following formula: in, Q * (f * )=(r * -c * )·f * , Q d (f d )=(r d -c d )·f d , λ represents the weight factor, f * Represents the first video frame rate parameter, p * Indicates the first resource acquisition consumption parameter, f d Indicates the second video frame rate parameter, represents the first video reception utility model, represents the second video receiving utility model, p d Indicates the second resource acquisition consumption parameter, p d is 0, c * Indicates the first resource receiving consumption parameter, r * represents the first experience quality parameter, c d Indicates the second resource receiving consumption parameter, r d represents a second experience quality parameter.

3. The method according to claim 2, characterized in that The resource configuration parameters include: a first resource sending consumption parameter, a first video frame rate parameter, a second resource sending consumption parameter and a second video frame rate parameter, and the resource request parameters include: a first resource acquisition consumption parameter and a second resource acquisition consumption parameter; The video sending end processes the resource configuration parameters and the received resource request parameters through a video sending utility algorithm to obtain a video sending utility increment model, including: The video sending end constructs a first video sending utility model through the following formula according to the first video frame rate parameter, the first resource acquisition consumption parameter, a preset weight factor and the first resource sending utility parameter; in, represents the first video sending utility model, f * Represents the first video frame rate parameter, p * represents the first resource acquisition consumption parameter, λ represents the weight factor, C(f * ) represents the first resource sending consumption parameter; The video sending end constructs a second video sending utility model by the following formula according to the second video frame rate parameter, the second resource acquisition consumption parameter, a preset weight factor and the second resource sending utility parameter; in, represents the second video sending utility model, fd represents the second video frame rate parameter, p d represents the second resource acquisition consumption parameter, λ represents the weight factor, C(f d ) indicates that the second resource sends a consumption parameter; The video sending end constructs the video sending utility increment model based on the first video sending utility model and the second video sending utility model by using the following formula: in, represents the incremental model of video sending utility, represents the first video sending utility model, represents the second video sending utility model, λ represents the weight factor, and f * Represents the first video frame rate parameter, p * represents the first resource acquisition consumption parameter, fd represents the second video frame rate parameter, pd represents the second resource acquisition consumption parameter, p d is 0, C(f * ) represents the first resource sending consumption parameter, C(f d ) indicates that the second resource sends consumption parameters.

4. The method according to claim 3, characterized in that The controller processes the received video receiving utility increment model and the received video sending utility increment model through a video transmission utility algorithm to construct a video transmission utility model, including: In response to the number of the video receiving terminals being 1, the controller constructs the video transmission utility model according to the received video reception utility increment model and the received video transmission utility increment model by using the following formula: in, represents the incremental model of the received video sending utility, represents the first video sending utility model, represents the second video sending utility model, f * Represents the first video frame rate parameter, p * Indicates the first resource acquisition consumption parameter, f d Represents the second video frame rate parameter, p d Indicates the second resource acquisition consumption parameter. represents the incremental model of the received video reception utility, represents the first video reception utility model, Represents a second video reception utility model.

5. The method according to claim 4, characterized in that The step of processing the video transmission utility model by using an equalization algorithm to obtain a target transmission strategy corresponding to a maximum value of the video transmission utility model includes: The controller processes the video transmission utility model based on the reverse induction algorithm through the following formula to obtain the maximum value of the video transmission utility model: in, represents the first video sending utility model, represents the second video sending utility model, represents the first video reception utility model, represents the second video receiving utility model, f* represents the first video frame rate parameter, p* represents the first resource acquisition consumption parameter, fd represents the second video frame rate parameter, pd represents the second resource acquisition consumption parameter, p d is 0, Q * (f * )=(r * -c * )·f * , Q d (f d )=(r d -c d )·f d , c * Indicates the first resource receiving consumption parameter, r * represents the first experience quality parameter, c d Indicates the second resource receiving consumption parameter, r d represents the second experience quality parameter, C(f * ) represents the first resource sending consumption parameter, C(f d ) indicates that the second resource sends a consumption parameter; The controller determines a first target video frame rate parameter and a first target resource acquisition consumption parameter based on a maximum value of the video transmission utility model, and uses the target video frame rate parameter and the target resource acquisition consumption parameter as the target transmission strategy.

6. The method according to claim 3, characterized in that The controller processes the received video receiving utility increment model and the received video sending utility increment model through a video transmission utility algorithm to construct a video transmission utility model, including: In response to the number of the video receiving terminals being greater than or equal to 2, the controller constructs the video transmission utility model according to the received video reception utility increment model and the received video transmission utility increment model by using the following formula: g n (D Θ -g n ) in, represents the incremental model of the received video sending utility, represents the incremental model of the received video reception utility, Indicates the video frame rate of other video receivers. represents the second target video frame rate, f d Indicates the second video frame rate parameter, It represents the incremental service utility when multiple video receivers reach a consensus. Indicates the service utility increment when multiple video receiving ends fail to reach a consensus and still use the second video frame rate parameter, ζ n Represents the utility increment of the video receiver.

7. The method according to claim 6, characterized in that The step of processing the video transmission utility model by using an equalization algorithm to obtain a target transmission strategy corresponding to a maximum value of the video transmission utility model includes: The controller processes the video transmission utility model based on the reverse induction algorithm through the following formula to obtain the maximum value of the video transmission utility model: maxz n (D Θ -g n ) stΔ Θ -g n ≥0,ζ n ≥0 in, represents the incremental model of the received video sending utility, represents the incremental model of the received video reception utility, Indicates the video frame rate of other video receivers. represents the second target video frame rate, f d Indicates the second video frame rate parameter, It represents the incremental service utility when multiple video receivers reach a consensus. Indicates the service utility increment when multiple video receiving ends fail to reach a consensus and still use the second video frame rate parameter, ζ n represents the utility increment of the video receiver; The controller determines a second target video frame rate parameter and a second target resource acquisition consumption parameter based on the maximum value of the video transmission utility model, and uses the second target video frame rate parameter and the second target resource acquisition consumption parameter as the target transmission strategy.

8. A multi-format video adaptive transmission device, characterized in that: The device is arranged in a video adaptive transmission system, the system comprising a controller, a video transmitting end and at least one video receiving end connected in communication, and the device comprises: The video receiving end is configured to obtain resource request parameters and send the resource request parameters to the video sending end; process the resource request parameters and the received resource configuration parameters through a video receiving utility algorithm to construct a video receiving utility increment model, and send the video receiving utility increment model to the controller; The video sending end is configured to determine resource configuration parameters based on the received resource request parameters, and send the resource configuration parameters to the video receiving end; according to the resource configuration parameters and the received resource request parameters, process them through a video sending utility algorithm to obtain a video sending utility increment model, and send the video sending utility increment model to the controller; The controller is configured to process the received video receiving utility increment model and the received video sending utility increment model through a video transmission utility algorithm to construct a video transmission utility model, and to process the video transmission utility model through an equalization algorithm to obtain a target transmission strategy corresponding to the maximum value of the video transmission utility model, and to control the video sending end and the video receiving end to perform a video transmission process according to the target transmission strategy.

9. An electronic device comprising a memory, a processor, and a computer program stored in the memory and running on the processor, characterized in that: When the processor executes the program, the method according to any one of claims 1 to 7 is implemented.

10. A non-transitory computer-readable storage medium storing computer instructions, characterized in that: The computer instructions are used to enable a computer to execute the method according to any one of claims 1 to 7.

Images