Video transmission method, device and system

Abstract

The present invention discloses a video transmission method, device and system. The method is applied to a server, including: receiving a video request from a user end; determining the current transmission resolution and the resolution improvement value according to the relevant parameters of the previous video block transmitted and the current state parameters carried by the video request; and transmitting the video block to be transmitted and the resolution improvement value to the user end after obtaining the video block to be transmitted with the current transmission resolution size. Since the server dynamically decides the resolution improvement size of the next video block to be transmitted by combining the relevant parameters of the previous video block transmitted and the current state parameters, the average transmission bit rate can be reduced, the bandwidth requirement can be reduced, the overall user experience can be improved, and the optimal video transmission service can be achieved.

Description

Technical Field

[0001] The present invention relates to the technical field of video transmission, and in particular to a video transmission method, device and system. Background Art

[0002] In video transmission services, dynamic bit rate technology is usually used to improve the quality of video transmission services.

[0003] In the related art, the dynamics of the network status is mainly considered to optimize the video transmission service, that is, the resolution size of the transmitted video is dynamically determined according to the changes in the network status.

[0004] However, the current transmission method that only considers the network status cannot achieve the optimal video transmission service. Summary of the invention

[0005] The purpose of the present invention is to provide a video transmission method, device and system to address the deficiencies of the above-mentioned prior art, and the purpose is achieved through the following technical solutions.

[0006] A first aspect of the present invention provides a video transmission method, which is applied to a server and includes:

[0007] Receive a video request from a user terminal;

[0008] Determine the current transmission resolution and the resolution improvement value according to the relevant parameters of the previous video block transmitted and the current state parameters carried by the video request;

[0009] After acquiring the video block to be transmitted with the current transmission resolution size, the video block to be transmitted and the resolution improvement value are transmitted to the user terminal.

[0010] A second aspect of the present invention provides a video transmission method, which is applied to a user terminal and includes:

[0011] receiving video blocks and resolution enhancement values ​​transmitted by a server;

[0012] Performing resolution enhancement on the video block according to the resolution enhancement value, and playing the video block after the resolution enhancement;

[0013] Acquire current state parameters and parameters related to the video block;

[0014] A video request for a next video block is generated according to the parameters related to the video block and the current state parameters, and sent to the server.

[0015] A third aspect of the present invention provides a video transmission device, which is applied to a server and includes:

[0016] A request receiving module, used for receiving a video request from a user terminal;

[0017] A determination module, configured to determine a current transmission resolution and a resolution improvement value according to relevant parameters of a previous video block transmitted and current status parameters carried by the video request;

[0018] The transmission module is used to obtain the video block to be transmitted with the current transmission resolution size, and then transmit the video block to be transmitted and the resolution improvement value to the user terminal.

[0019] A fourth aspect of the present invention provides a video transmission device, which is applied to a user terminal and includes:

[0020] A video receiving module, used for receiving video blocks and resolution enhancement values ​​transmitted by a server;

[0021] A video playing module, configured to increase the resolution of the video block according to the resolution increase value, and play the video block after the resolution increase;

[0022] A parameter acquisition module, used to acquire current state parameters and parameters related to the video block;

[0023] The request sending module is used to generate a video request including parameters related to the video block and current state parameters and send the request to the server.

[0024] A fifth aspect of the present invention provides a video transmission system, the system comprising:

[0025] The server is configured to, after receiving a video request from a user terminal, determine a current transmission resolution and a resolution improvement value according to relevant parameters of a previous video block transmitted and current state parameters carried in the video request; after acquiring a video block to be transmitted with the current transmission resolution, transmit the video block to be transmitted and the resolution improvement value to the user terminal;

[0026] The user end is used to increase the resolution of the received video block to be transmitted according to the received resolution increase value, and play the video block with the increased resolution; obtain the current state parameter and the parameters related to the video block; generate a video request for the next video block according to the parameters related to the video block and the current state parameter, and send it to the server.

[0027] A sixth aspect of the present invention provides a computer-readable storage medium having a computer program stored thereon, wherein the program, when executed by a processor, implements the steps of the method described in the first aspect or the second aspect above.

[0028] Based on the video transmission method described in the first and second aspects above, the present application has the following beneficial effects:

[0029] When the user terminal requests each video block, considering that its own computing power is inferior to that of the server, it will send the current state parameters and the relevant parameters of the previous video block to the server. The server will decide the resolution of the next video block to be transmitted and the resolution increase size based on these relevant parameters and various factors of the current state parameters. After obtaining the video block of the resolution size, the obtained video block and the decided resolution increase size are transmitted to the user terminal. The user terminal increases the resolution of the received video block according to the received resolution increase size and plays the video block with the increased resolution. Since the server dynamically decides the resolution increase size of the next video block to be transmitted based on multiple factors including the relevant parameters of the previous video block and the current state parameters, it can reduce the average transmission bit rate, reduce bandwidth requirements, improve the overall user experience, and achieve the best video transmission service. BRIEF DESCRIPTION OF THE DRAWINGS

[0030] The drawings described herein are used to provide a further understanding of the present invention and constitute a part of the present invention. The exemplary embodiments of the present invention and their descriptions are used to explain the present invention and do not constitute an improper limitation of the present invention. In the drawings:

[0031] Figure 1 This is a flow chart of an embodiment of a video transmission method according to an exemplary embodiment of the present invention;

[0032] Figure 2 This is a flow chart of another video transmission method according to an exemplary embodiment of the present invention;

[0033] Figure 3 It is a structural schematic diagram of a video transmission system according to an exemplary embodiment of the present invention;

[0034] Figure 4 It is a structural schematic diagram of a video transmission device according to an exemplary embodiment of the present invention;

[0035] Figure 5 It is a structural schematic diagram of another video transmission device according to an exemplary embodiment of the present invention;

[0036] Figure 6 The figure is a schematic diagram of the structure of a storage medium according to an exemplary embodiment of the present invention. DETAILED DESCRIPTION

[0037] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present invention. Instead, they are merely examples of devices and methods consistent with some aspects of the present invention as detailed in the appended claims.

[0038] The terms used in the present invention are only for the purpose of describing specific embodiments and are not intended to limit the present invention. The singular forms "a", "the" and "the" used in the present invention and the appended claims are also intended to include plural forms unless the context clearly indicates other meanings. It should also be understood that the term "and / or" used herein refers to and includes any or all possible combinations of one or more associated listed items.

[0039] It should be understood that although the terms first, second, third, etc. may be used in the present invention to describe various information, these information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other. For example, without departing from the scope of the present invention, the first information may also be referred to as the second information, and similarly, the second information may also be referred to as the first information. Depending on the context, the word "if" as used herein may be interpreted as "at the time of" or "when" or "in response to determining".

[0040] Embodiment 1

[0041] Figure 1 The flowchart of a video transmission method according to an exemplary embodiment of the present invention is applied to a server side providing video services. In the embodiment of the present application, each video stored in the server is pre-divided into video blocks of the same length, and each video block is processed into video blocks of different resolutions so that different resolutions can be selected during transmission. Figure 1 As shown, the video transmission method includes the following steps:

[0042] Step 101: Receive a video request from a user terminal.

[0043] The video request carries the video identifier of the video requested by the user end, the relevant parameters for transmitting the last video block, and the current state parameters.

[0044] Those skilled in the art can understand that if the video request is a request for the first video block sent by the user end, the video request does not include the relevant parameters for transmitting the previous video block, or includes a default relevant parameter.

[0045] In this embodiment, the relevant parameters for transmitting the previous video block carried in the video request represent a series of action parameters involved in playing the previous video block, and the current status parameters carried in the video request represent the current status between the server and the user end, such as the computing power currently allocated by the user end for the video playback task, the current network status parameters between the user end and the server, etc.

[0046] Step 102: Determine the current transmission resolution and the resolution improvement value according to the relevant parameters of the previous video block transmitted and the current state parameters carried in the video request.

[0047] In an optional specific embodiment, the relevant parameters of the previous video block transmitted and the current state parameters may be input into a trained neural network decision model, so that the neural network decision model may decide the current transmission resolution and the resolution enhancement value based on the relevant parameters and the current state parameters.

[0048] Among them, the neural network decision model adopts a decision model implemented by the reinforcement learning method. Before using the decision model, it is necessary to initialize the model parameters in advance and sample continuous data with a duration of N in the training data, that is, the data of the N consecutive video block sending process. The data of each video block contains:

[0049] (1) State s: state parameters between the server and the client, such as the bandwidth size and network congestion status used to characterize the network status, and the computing power allocated by the client for the video playback task;

[0050] (2) Action a: the current transmission resolution of the video block and the resolution increase size when playing the video block;

[0051] (3) Report r: the average resolution size of the played video blocks, that is, the average resolution after the resolution is improved using super-resolution technology.

[0052] When training the decision-making model, a Q-value function is used to evaluate the value of each action. Q is Q(s,a), which refers to the expected benefit of taking action a(a∈A) at a certain state s(s∈S). The environment will feedback the corresponding reward r based on the agent's action, so the main idea of ​​the algorithm is to construct the state s and action a into a Q-table to store the Q value, and then select the action that can obtain the maximum benefit based on the Q value.

[0053] Assume that the data of N consecutive video blocks contains {s i ,a i ,r i}, i∈[1,N], initialize the Q function Q(s i ,a i ), and then calculate the Q value using the following formula:

[0054]

[0055] Among them, Q(s i ,a i ) is to take an action a i After the state s i Transfer to state s i+1 Q value; α is the learning rate, fixed value; r i Is to perform action a i After the state s i Transfer to state s i+1 The return obtained; γ is the discount factor, a fixed value; is the next state s i+1 The maximum value of the Q value corresponding to all executable actions a' in .

[0056] Finally, the model parameters are updated by stochastic gradient descent.

[0057] It can be seen that the current state parameters include the computing power currently allocated by the client for the video playback task (expressed in flops), the current network state between the client and the server. The parameters related to the video block include the resolution of the previous video block and the resolution improvement value.

[0058] That is to say, the server can decide whether to transmit the next video block based on various factors, including the resolution and resolution improvement value of the previous video block, the current computing power of the user end, and the network status.

[0059] Step 103: After obtaining the video block to be transmitted with the current transmission resolution, the video block to be transmitted and the resolution improvement value are transmitted to the user terminal.

[0060] In an optional specific embodiment, since the server stores a series of continuous video blocks corresponding to the same video data in different resolution states, video blocks with the same video content but different resolutions can be used as associated video blocks.

[0061] Specifically, the video identifier of the video to which the previous video block belongs can be obtained, and the video data of the current transmission resolution corresponding to the video identifier can be determined, and the next video block of the video block associated with the previous video block can be read from the video data as the video block to be transmitted, wherein the associated video block is a video block of the current transmission resolution size.

[0062] At this point, the above Figure 1In the video transmission process on the server side shown, when the user terminal requests a video block, considering that its own computing power is inferior to that of the server, it will send the current state parameters and the relevant parameters of the previous video block to the server. The server will decide the resolution of the next video block to be transmitted and the resolution increase size based on these relevant parameters and various factors of the current state parameters. After the server obtains the video block of the resolution size, it will transmit the obtained video block and the decided resolution increase size to the user terminal. The user terminal will increase the resolution of the received video block according to the received resolution increase size and play the video block with the increased resolution. Since the server dynamically decides the resolution increase size of the next video block to be transmitted based on multiple factors including the relevant parameters of the previous video block and the current state parameters, it can reduce the average transmission bit rate, reduce bandwidth requirements, improve the overall user experience, and achieve the best video transmission service.

[0063] Embodiment 2

[0064] Figure 2 FIG. 1 is a flow chart of another video transmission method according to an exemplary embodiment of the present invention. The video transmission method is applied to a user terminal that provides video services. Figure 1 Based on the embodiment shown, Figure 2 As shown, the video transmission method includes the following steps:

[0065] Step 201: Receive a video block and a resolution improvement value transmitted by a server.

[0066] The resolution increase value transmitted by the server is the resolution increase size required for the video block.

[0067] Step 202: increasing the resolution of the video block according to the resolution increase value, and playing the video block with the increased resolution.

[0068] In an optional specific embodiment, for the resolution enhancement process, a target resolution may be determined according to the resolution enhancement value and the current resolution of the video block, and then the current resolution of the video block may be enhanced to the target resolution.

[0069] For example, the current resolution of the transmitted video block is 720p, and the transmitted resolution increase value is 360p, then the target resolution is 720p+360p=1080p.

[0070] Exemplarily, super-resolution technology may be used to increase the resolution of video blocks.

[0071] Step 203: Acquire current state parameters and parameters related to the video block.

[0072] In an optional specific embodiment, the computing power currently allocated by the user terminal to the video playback task and the current network status between the user terminal and the server can be obtained, and the computing power and the current network status are used as current status parameters, and the resolution enhancement value and the current resolution of the video block are used as parameters related to the video block.

[0073] Step 204: Generate a video request for the next video block according to the parameters related to the video block and the current state parameters and send it to the server.

[0074] At this point, the above Figure 2 In the video transmission process on the user side shown, when the user side requests a video block, considering that its own computing power is inferior to that of the server, it will send the current state parameters and the relevant parameters of the previous video block to the server. The server will decide the resolution of the next video block to be transmitted and the resolution increase size based on these relevant parameters and various factors of the current state parameters. After the server obtains the video block of the resolution size, it will transmit the obtained video block and the decided resolution increase size to the user side. The user side will increase the resolution of the received video block according to the received resolution increase size and play the video block with the increased resolution. Since the server dynamically decides the resolution increase size of the next video block to be transmitted based on multiple factors including the relevant parameters of the previous video block and the current state parameters, it can reduce the average transmission bit rate, reduce bandwidth requirements, improve the overall user experience, and achieve the best video transmission service.

[0075] Embodiment 3

[0076] Figure 3 This is a schematic diagram of a video transmission system according to an exemplary embodiment of the present invention. Figure 1 to Figure 2 Based on the illustrated embodiment, the system comprises:

[0077] The server is configured to, after receiving a video request from a user terminal, determine a current transmission resolution and a resolution improvement value according to relevant parameters of a previous video block transmitted and current state parameters carried in the video request; after acquiring a video block to be transmitted with the current transmission resolution, transmit the video block to be transmitted and the resolution improvement value to the user terminal;

[0078] The user end is used to increase the resolution of the received video block to be transmitted according to the received resolution increase value, and play the video block with the increased resolution; obtain the current state parameter and the parameters related to the video block; generate a video request for the next video block according to the parameters related to the video block and the current state parameter, and send it to the server.

[0079] The specific process is as follows:

[0080] When the server receives a video request, it decides the current transmission resolution and the resolution improvement value based on the relevant parameters of the previous video block and the current status parameters carried in the video request. Then the server reads the next video block of the video block associated with the previous video block (a video block of the current transmission resolution size) as the video block to be transmitted, and transmits the video block to be transmitted and the resolution improvement value to the user end.

[0081] When the user end receives the video block and the resolution enhancement value transmitted by the server, the resolution of the video block is enhanced according to the resolution enhancement value, and the video block with the enhanced resolution is played. Then, the computing power currently allocated by the user end to the video playback task and the current network state between the user end and the server are obtained as current state parameters, and the resolution enhancement value and the current resolution of the video block are simultaneously used as parameters related to the video block. Finally, a video request for the next video block is generated according to the parameters related to the video block and the current state parameters, and sent to the server, and so on, until the server completes the transmission of all video content of a certain video data.

[0082] Figure 4 FIG. 1 is a schematic diagram of a structure of a video transmission device according to an exemplary embodiment of the present invention. The video transmission device is applied to a server side that provides video services. Based on the above method embodiment, as shown in FIG. Figure 4 As shown, the video transmission device includes:

[0083] The request receiving module 410 is used to receive a video request from a user terminal;

[0084] A determination module 420, configured to determine a current transmission resolution and a resolution improvement value according to relevant parameters of a previous video block transmitted and current state parameters carried in the video request;

[0085] The transmission module 430 is configured to transmit the video block to be transmitted and the resolution improvement value to the user terminal after acquiring the video block to be transmitted with the current transmission resolution size.

[0086] Figure 5 FIG. 1 is a schematic diagram of the structure of another video transmission device according to an exemplary embodiment of the present invention. The video transmission device is applied to a user terminal side. Based on the above method embodiment, as shown in FIG. Figure 5 As shown, the video transmission device includes:

[0087] The video receiving module 510 is used to receive the video block and the resolution improvement value transmitted by the server;

[0088] The video playing module 520 is used to increase the resolution of the video block according to the resolution increase value, and play the video block with the increased resolution;

[0089] A parameter acquisition module 530, used to acquire current state parameters and parameters related to the video block;

[0090] The request sending module 540 is used to generate a video request including parameters related to the video block and current state parameters and send the request to the server.

[0091] The implementation process of the functions and effects of each unit in the above-mentioned device is specifically described in the implementation process of the corresponding steps in the above-mentioned method, and will not be repeated here.

[0092] For the device embodiment, since it basically corresponds to the method embodiment, the relevant parts can refer to the partial description of the method embodiment. The device embodiment described above is only schematic, wherein the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the scheme of the present invention. Ordinary technicians in this field can understand and implement it without paying creative work.

[0093] The present application also provides a computer-readable storage medium corresponding to the video transmission method provided in the above embodiment. Figure 6 As shown, the computer-readable storage medium shown is an optical disc 30 on which a computer program (ie, a program product) is stored. When the computer program is run by a processor, the video transmission method provided by any of the aforementioned embodiments will be executed.

[0094] It should be noted that examples of the computer-readable storage medium may also include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other optical or magnetic storage media, which are not listed here one by one.

[0095] Those skilled in the art will readily appreciate other embodiments of the present invention after considering the specification and practicing the invention disclosed herein. The present invention is intended to cover any variations, uses or adaptations of the present invention that follow the general principles of the present invention and include common knowledge or customary techniques in the art not disclosed by the present invention. The description and examples are to be regarded as exemplary only, and the true scope and spirit of the present invention is indicated by the following claims.

[0096] It should also be noted that the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, commodity or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, commodity or device. In the absence of more restrictions, the elements defined by the sentence "comprises a ..." do not exclude the existence of other identical elements in the process, method, commodity or device including the elements.

[0097] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present invention should be included in the scope of protection of the present invention.

Claims

1. A video transmission method, characterized in that: The method is applied to a server, and the method comprises: Receive a video request from a user terminal; Determine the current transmission resolution and the resolution improvement value according to the relevant parameters of the last video block transmitted and the current state parameters carried by the video request; the current state parameters include the computing power allocated by the user end for the video playback task and the network state between the user end and the server; After acquiring the video block to be transmitted of the current transmission resolution size, the video block to be transmitted and the resolution improvement value are transmitted to the user terminal; The method of determining the current transmission resolution and the resolution improvement value according to the relevant parameters of the previous video block transmitted and the current state parameters carried by the video request includes: The relevant parameters of the last video block transmitted and the current state parameters are input into the trained neural network decision model, so that the neural network decision model decides the current transmission resolution and the resolution improvement value based on the relevant parameters and the current state parameters.

2. The method according to claim 1, characterized in that Obtaining the video block to be transmitted of the current transmission resolution size, including: Obtaining a video identifier of the video to which the previous video block belongs; The video data of the current transmission resolution corresponding to the video identifier is determined, and the next video block of the video block associated with the previous video block is read from the video data as the video block to be transmitted; wherein the associated video block is a video block of the current transmission resolution size.

3. A video transmission method, characterized in that: The method is applied to a user terminal, and the method comprises: receiving video blocks and resolution enhancement values ​​transmitted by a server; Performing resolution enhancement on the video block according to the resolution enhancement value, and playing the video block after the resolution enhancement; Acquire current state parameters and parameters related to the video block; the current state parameters include computing power allocated by the user end for the video playback task and a network state between the user end and the server; A video request for a next video block is generated according to the parameters related to the video block and the current state parameters, and sent to the server, so that the server determines the current transmission resolution and the resolution improvement value of the next video block according to the parameters related to the video block and the current state parameters.

4. The method according to claim 3, characterized in that: Improving the resolution of the video block according to the resolution improvement value includes: Determining a target resolution according to the resolution increase value and a current resolution of the video block; The current resolution of the video block is increased to the target resolution.

5. The method according to claim 3, characterized in that: Obtaining current state parameters and parameters related to the video block, including: Acquire the computing power currently allocated by the client to the video playback task, and the current network status between the client and the server; Using the computing capacity and the current network state as current state parameters; The resolution increase value and the current resolution of the video block are used as parameters related to the video block.

6. A video transmission device, characterized in that: The device is applied to a server, and comprises: A request receiving module, used for receiving a video request from a user terminal; A determination module, configured to determine a current transmission resolution and a resolution improvement value according to relevant parameters of a previous video block transmitted and current status parameters carried by the video request; the current status parameters include a computing power allocated by the user terminal for the video playback task and a network status between the user terminal and the server; A transmission module, configured to obtain the video block to be transmitted with the current transmission resolution, and then transmit the video block to be transmitted and the resolution improvement value to the user terminal; The determination module is specifically used to input the relevant parameters of the transmission of the previous video block and the current state parameters into the trained neural network decision model, so that the neural network decision model decides the current transmission resolution and the resolution improvement value based on the relevant parameters and the current state parameters.

7. A video transmission device, characterized in that: The device is applied to a user terminal, and comprises: A video receiving module, used for receiving video blocks and resolution enhancement values ​​transmitted by a server; A video playing module, configured to increase the resolution of the video block according to the resolution increase value, and play the video block after the resolution increase; A parameter acquisition module, used to acquire current state parameters and parameters related to the video block; the current state parameters include the computing power allocated by the user end for the video playback task and the network state between the user end and the server; The request sending module is used to generate a video request including parameters related to the video block and current state parameters and send the request to the server, so that the server determines the current transmission resolution and resolution improvement value of the next video block according to the parameters related to the video block and the current state parameters.

8. A video transmission system, characterized in that: The system comprises: The server is used to, after receiving a video request from a user terminal, determine the current transmission resolution and the resolution improvement value according to the relevant parameters of the previous video block transmitted and the current state parameters carried by the video request through a trained neural network decision model; after obtaining the video block to be transmitted with the current transmission resolution size, transmit the video block to be transmitted and the resolution improvement value to the user terminal; the current state parameters include the computing power allocated by the user terminal for the video playback task and the network state between the user terminal and the server; The user end is used to increase the resolution of the received video block to be transmitted according to the received resolution increase value, and play the video block with the increased resolution; obtain the current state parameter and the parameters related to the video block; generate a video request for the next video block according to the parameters related to the video block and the current state parameter, and send it to the server.

9. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the steps of the method according to any one of claims 1 to 5 are implemented.

Images