Video Data Transmission Method, Device, Electronic Device and Medium

Abstract

Embodiments of the present disclosure disclose a video data transmission method, apparatus, electronic device, and computer-readable medium. A specific implementation of the method includes: obtaining video coding data after encoding a target video, where the target video corresponds to a plurality of image regions, and the plurality of image regions are obtained during the encoding process of the target video, and the video coding data includes sub-data of at least one resolution corresponding to each of the plurality of image regions; determining a quantization parameter for each image region according to the current transmission mode; for each image region, transmitting the sub-data of at least one resolution corresponding to the image region according to the quantization parameter of the image region. This implementation realizes dynamically and flexibly selecting a transmission scheme according to different quantization parameters of the video to achieve an optimal playback effect.

Description

Technical Field

[0001] Embodiments of the present disclosure relate to the field of computer technologies, and more particularly, to methods, devices, electronic devices, and computer-readable media for video data transmission. Background Art

[0002] In related VR (Virtual Reality) video data transmission, a view-based data transmission method is generally adopted. Specifically, high-definition encoded data is provided for the main view, while low-definition encoded data is provided for other views. The advantage of this approach is that since the encoding complexity and bit rate of low-definition data are relatively low, the decoding pressure and bandwidth requirements at the playback end can be reduced.

[0003] However, when the above transmission method is adopted, the following technical problems often exist:

[0004] When the user's view changes, the low-definition encoded data originally provided needs to be switched to high-definition encoded data, which may cause switching delays. Summary of the Invention

[0005] The content part of the present disclosure is used to briefly introduce concepts, which will be described in detail in the following detailed implementation part. The content part of the present disclosure is not intended to identify the key features or essential features of the claimed technical solution, nor is it intended to limit the scope of the claimed technical solution. Some embodiments of the present disclosure propose methods for video data transmission, data reading and writing methods, devices, electronic devices, and computer-readable media to solve one or more of the technical problems mentioned in the above background art part.

[0006] In a first aspect, some embodiments of the present disclosure provide a method for video data transmission, including: obtaining video encoded data after encoding a target video, where the target video corresponds to a plurality of image regions, and the plurality of image regions are obtained during the encoding process of the target video, and the video encoded data includes sub-data of at least one resolution corresponding to each of the plurality of image regions; determining a quantization parameter for each image region according to the current transmission mode; and for each image region, transmitting the sub-data of at least one resolution corresponding to the image region according to the quantization parameter of the image region.

[0007] In a second aspect, some embodiments of the present disclosure provide a video data transmission device, including: an acquisition unit configured to acquire video coding data after encoding a target video, where the target video corresponds to a plurality of image regions, and the plurality of image regions are obtained during the encoding process of the target video, and the video coding data includes sub-data of at least one resolution corresponding to each of the plurality of image regions; a determination unit configured to determine a quantization parameter for each image region according to the current transmission mode; and a transmission unit configured to, for each image region, transmit the sub-data of at least one resolution corresponding to the image region according to the quantization parameter of the image region.

[0008] In a third aspect, some embodiments of the present disclosure provide an electronic device, including: one or more processors; a storage device storing one or more programs thereon, and when the one or more programs are executed by the one or more processors, the one or more processors implement the method described in any implementation manner of the first aspect above.

[0009] In a fourth aspect, some embodiments of the present disclosure provide a computer-readable medium storing a computer program thereon, where when the program is executed by a processor, the method described in any implementation manner of the first aspect above is implemented.

[0010] The above embodiments of the present disclosure have the following beneficial effects: It realizes the dynamic and flexible selection of a transmission scheme according to different quantization parameters of the video to achieve the optimal playback effect. Specifically, it is found in practice that for most image regions, especially for image regions with relatively high quantization parameter values, the coding complexity and bit rate difference between high-definition and low-definition coding data are not significant. That is to say, for these image regions, even if high-definition coding data is transmitted, it will not cause additional pressure on the decoder at the playback end, and it can also avoid the switching delay caused by switching between high-definition and low-definition coding data. Based on this, some embodiments of the present disclosure can balance the decoding pressure and switching delay by determining the quantization parameter and selecting different transmission schemes according to the quantization parameter to achieve the optimal playback effect. BRIEF DESCRIPTION OF THE DRAWINGS

[0011] Combined with the accompanying drawings and referring to the following specific embodiments, the above and other features, advantages and aspects of the embodiments of the present disclosure will become more obvious. Throughout the drawings, the same or similar reference numerals represent the same or similar elements. It should be understood that the drawings are schematic, and the elements and elements are not necessarily drawn to scale.

[0012] Figure 1 is a schematic diagram of an application scenario of the video data transmission method according to some embodiments of the present disclosure;

[0013] Figure 2is a flowchart of some embodiments of the video data transmission method according to the present disclosure;

[0014] Figure 3 is an exemplary diagram of multiple image regions corresponding to a target video in the video data transmission method according to the present disclosure;

[0015] Figure 4 is a flowchart of some other embodiments of the video data transmission method according to the present disclosure;

[0016] Figure 5 is a schematic structural diagram of some embodiments of the video data transmission device according to the present disclosure;

[0017] Figure 6 is a schematic structural diagram of an electronic device suitable for implementing some embodiments of the present disclosure. Detailed implementation manners

[0018] Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although some embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as limited to the embodiments set forth herein. On the contrary, these embodiments are provided to more thoroughly and completely understand the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are only for illustrative purposes and are not used to limit the protection scope of the present disclosure.

[0019] In addition, it should be noted that for the sake of convenience of description, only parts related to the relevant invention are shown in the drawings. Without conflict, the embodiments in the present disclosure and the features in the embodiments can be combined with each other.

[0020] It should be noted that the concepts such as "first" and "second" mentioned in the present disclosure are only used to distinguish different devices, modules or units, and are not used to limit the order of functions performed by these devices, modules or units or their interdependent relationships.

[0021] It should be noted that the modifications of "one" and "multiple" mentioned in the present disclosure are illustrative rather than restrictive. Those skilled in the art should understand that unless otherwise clearly specified in the context, it should be understood as "one or more".

[0022] The names of the messages or information exchanged between multiple devices in the embodiments of the present disclosure are only for illustrative purposes and are not used to limit the scope of these messages or information.

[0023] The present disclosure will be described in detail below with reference to the drawings and in conjunction with the embodiments.

[0024] Figure 1 is a schematic diagram of an application scenario of the video data transmission method of some embodiments of the present disclosure.

[0025] As shown Figure 1 in the figure, the server 101 can provide VR videos to the terminal 102. The video encoding data corresponding to the VR videos can be stored in the server 101. In this application scenario, the video can be encoded using the H.265 standard. During the encoding process, the video frame is divided into several image regions. Taking the division into 9 image regions as an example in this application scenario, as shown by 103 in the figure. Each image region can respectively correspond to at least one resolution of sub-data. For example, there can be two resolutions of sub-data, high definition and low definition, existing simultaneously in a certain image region.

[0026] On this basis, the server 101 can determine the quantization parameter of each image region according to the current transmission method. For each image region, according to the quantization parameter of the image region, at least one resolution of sub-data corresponding to the image region is transmitted. As an example, for the image regions 1031, 1032, and 1033, their quantization parameters can be determined respectively. Then, for the image region 1031, since its quantization parameter value is high, the corresponding high-definition data is always transmitted. For the image region 1032, since its quantization parameter value is low and it is not within the current field of view 104, the corresponding low-definition data is transmitted. For the image region 1033, since its quantization parameter value is low but it is within the field of view 104, the corresponding high-definition data is transmitted.

[0027] Continuing to refer to Figure 2 , a flow 200 of some embodiments of the video data transmission method according to the present disclosure is shown. The video data transmission method includes the following steps:

[0028] Step 201, obtaining the video encoding data after the target video is encoded.

[0029] In some embodiments, the execution subject of the video data transmission method can first obtain the video encoding data after the target video is encoded. Among them, the target video can be any video. For example, the currently to-be-transmitted video can be determined as the target video. In practice, according to different transmission methods, the target video can also be a video segment. Since the amount of original video data is huge, directly transmitting it will occupy a large amount of network resources, which will in turn cause serious lag and long time consumption when the user watches or downloads the video. Therefore, generally, the video is encoded before transmission. As an example, the H.265 standard can be used to encode and decode the video.

[0030] In practice, during the encoding of a target video, the video frame is often divided as needed to obtain multiple image regions (tiles) corresponding to the target video. The content in each frame image belonging to the same image region has a certain temporal correlation, which helps to achieve encoding.

[0031] Figure 3 FIG. shows an exemplary schematic diagram of multiple image regions corresponding to the target video. Taking the target video including frame image 301 and frame image 302 as an example, image 301 can be divided into three rectangular regions in the vertical direction, namely rectangular regions 3011, 3012, and 3013. It can be understood that, according to needs, it is possible to flexibly select to divide into several rectangular regions in the horizontal and / or vertical directions. Similarly, frame image 302 can be divided to obtain rectangular regions 3021, 3022, and 3023. In practice, within a certain range, generally the same division method is used for division. On this basis, the rectangular regions at the same position in each frame image belong to the same image region. For example, rectangular region 3011 in frame image 301 and rectangular region 3021 in frame image 302 belong to the same image region. The target video corresponds to three image regions.

[0032] On this basis, encoding the content (rectangular regions) in each frame image corresponding to each image region can obtain the sub-data corresponding to the image region. In practice, some image regions can correspond to sub-data with different resolutions to meet different requirements.

[0033] Step 202, determining the quantization parameter for each image region.

[0034] In some embodiments, the above-mentioned execution entity can determine the quantization parameter for each image region according to the current transmission mode. In practice, according to actual needs, different transmission modes can be used for transmission. According to the different transmission modes, different methods can be used to determine the quantization parameter for each image region. As an example, the transmission modes can include omaf-dash, webrtc (data transmission related protocol), etc. Among them, omaf (omnidirectional media application format, the input / output interface standard for VR systems) and DASH (Dynamic Adaptive Streaming over HTTP) is adaptive streaming transmission. By pre-storing data with different resolutions and corresponding description files of the same content on the server side in advance, the client can select the most suitable version according to its own performance and network environment during playback.

[0035] As an example, the above-mentioned execution entity can calculate the quantization parameter for each image region through the following steps:

[0036] In the first step, in response to the current transmission mode being the first transmission mode, determine the corresponding packaged file for each image region within the target time period.

[0037] Among them, the first transmission mode can be those transmission modes that package and transmit video coding data lines. For example, the transmission mode of omaf-dash will package the video coding data of each image region within a period of time to obtain a packaged file. That is to say, the sub-data of the video coding data exists in the form of a packaged file. Thus, the above-mentioned execution entity can determine the corresponding packaged file for each image region within the target time period. As an example, if packaging is performed every 2 seconds to obtain a packaged file. Then, each packaged file will correspond to a time interval. For example, from 10 minutes 0 seconds to 10 minutes 2 seconds. On this basis, the target time period can be the time interval corresponding to any packaged file. As an example, the time interval of the currently to-be-transmitted packaged file can be determined as the target time period. In practice, for the case where there are sub-data with multiple resolutions, the quantization parameter can be calculated based on the packaged file with the highest resolution.

[0038] In the second step, for each image region, determine the average quantization parameter of the packaged file corresponding to the image region, and use the average quantization parameter of the packaged file as the quantization parameter of the image region.

[0039] Among them, for each image region, the above-mentioned execution entity can first determine the average quantization parameter of the packaged file corresponding to the image region. Specifically, each image region also includes multiple coding units (CTU, Coding Tree Unit). As an example, for each image region, the mean value of the quantization parameters of the respective coding units included in the image region can be determined as the average quantization parameter of the image region. Among them, the quantization parameter (qp) of each coding unit can be calculated by the method stipulated in standards such as H.265. On this basis, use the average quantization parameter of the packaged file as the quantization parameter of the image region. Thus, it can be seen that as time goes by, even for the same image region, due to different packaged files being sent, the quantization parameter of the image region will also change accordingly. In addition, according to actual needs, the weighted mean value of the quantization parameters of each coding unit can also be determined and the weighted mean value can be determined as the average quantization parameter.

[0040] Step 203, for each image region, according to the quantization parameter of the image region, transmit the sub-data of at least one resolution corresponding to the image region.

[0041] In some embodiments, for each image region, the above-mentioned execution entity may transmit sub-data of at least one resolution corresponding to the image region according to the quantization parameter of the image region.

[0042] As an example, the quantization parameter of the image region may be compared with a preset quantization parameter threshold. If it is greater than the quantization parameter threshold, only the high-definition sub-data corresponding to the image region may be transmitted. If it is less than the quantization parameter threshold, the high-definition and low-definition sub-data corresponding to the image region may be flexibly transmitted according to the actual situation.

[0043] In some embodiments, over time, the quantization parameter of the same image region will also change. And the change of the quantization parameter will lead to different transmission schemes. Thus, a transmission scheme can be dynamically and flexibly selected according to different quantization parameters of the video to achieve an optimal playback effect. Specifically, it is found in practice that for most image regions, especially those with relatively high quantization parameter values, the encoding complexity and bit rate of these regions are relatively low, and the encoding complexity and bit rate difference between the high-definition and low-definition encoded data are not significant. That is to say, for these image regions, even if the high-definition encoded data is transmitted, it will not cause additional pressure on the decoder at the playback end, and can also avoid the switching delay caused by switching between high-definition and low-definition encoded data. Based on this, some embodiments of the present disclosure can balance the decoding pressure and switching delay by determining the quantization parameter and selecting different transmission schemes according to the quantization parameter to achieve an optimal playback effect.

[0044] Continue to refer to Figure 4 , which shows a flow 400 of some other embodiments of the video data transmission method according to the present disclosure. The video data transmission method includes the following steps:

[0045] Step 401, obtain the video encoded data after encoding the target video.

[0046] In some embodiments, the specific implementation of step 401 and the technical effects brought by it may refer to Figure 2 Step 201 in the corresponding embodiments, which will not be elaborated here.

[0047] Step 402, in response to the current transmission mode being the second transmission mode, determine multiple coding units corresponding to each image region in the video frame group within the target time period.

[0048] In some embodiments, the second transmission method may be another transmission method different from the first transmission method. Different from the first transmission method, the second transmission method does not transmit data after packing, but transmits data in the form of a group of pictures (GOP). Among them, a group of pictures includes several video frames. These video frames generally have a certain correlation in content. For example, the second transmission method may be WebRTC.

[0049] In some embodiments, in response to the current transmission method being the second transmission method, the execution subject of the video data transmission method may determine multiple coding units corresponding to each image region in the group of pictures (GOP) within the target time period. Among them, similar to the packed file, the group of pictures also has a corresponding time interval. At this time, the target time period may be the time interval corresponding to any group of pictures. As an example, the time interval of the currently to-be-transmitted group of pictures may be determined as the target time period.

[0050] On this basis, the above-mentioned execution subject may determine multiple coding units corresponding to each image region in the group of pictures within the target time period.

[0051] Step 403: For each image region, determine the average quantization parameter of the multiple coding units corresponding to the image region, and use the average quantization parameter of the multiple coding units as the quantization parameter of the image region.

[0052] In some embodiments, for a certain image region, the above-mentioned execution subject may determine the mean value of the quantization parameters of the multiple coding units corresponding to the image region to obtain the average quantization parameter. Then, use the average quantization parameter as the quantization parameter of the image region. It can be seen that as time goes by, even for the same image region, due to different groups of pictures sent, the quantization parameter of the image region will also change accordingly. That is to say, whether it is the transmission method of transmitting packed files or the transmission method of transmitting groups of pictures, the quantization parameter of the image region will change accordingly.

[0053] Step 404: For each image region, determine the sorting position of the quantization parameter of the image region among the quantization parameters corresponding to the multiple image regions.

[0054] In some embodiments, for each image region, the above-mentioned execution subject may determine the sorting position of the quantization parameter of the image region among the quantization parameters corresponding to the multiple image regions according to the size of the quantization parameter. Among them, the sorting position may be represented by indicators such as sorting order and sorting order ratio. For example, the sorting order may be the 5th in the queue. The sorting order ratio may be the top 20% in the queue, etc.

[0055] Step 405: Transmit the sub-data of at least one resolution corresponding to the image region based on the sorting position.

[0056] In some embodiments, the above-mentioned execution entity may transmit the sub-data of at least one resolution corresponding to the image region based on the sorting position. Among them, compared with the fixed threshold, the sorting position can more accurately reflect the relative size of the quantization parameter of each image region in the whole. By setting preset conditions, it can be ensured that for most image regions, high-definition encoded data is transmitted to minimize the switching delay caused by switching between high-definition and low-definition encoded data.

[0057] In some alternative implementation manners of some embodiments, in response to the sorting position satisfying the preset condition, transmit the sub-data of the first resolution corresponding to the image region. Among them, as an example, the preset condition may be that the proportion of the sorting position is greater than the preset proportion threshold.

[0058] In some alternative implementation manners of some embodiments, in response to determining that the sorting position does not satisfy the preset condition and the image region is within the current field of view, transmit the sub-data of the first resolution corresponding to the image region, and the current field of view is determined by the field-of-view parameters from the terminal. Among them, as an example, the first resolution may be high definition (1080P), ultra high definition, etc.

[0059] In some alternative implementation manners of some embodiments, transmitting the sub-data of at least one resolution corresponding to the image region based on the sorting position includes: in response to the sorting position not satisfying the preset condition and the image region not being within the current field of view, transmit the sub-data of the second resolution corresponding to the image region. Among them, as an example, the second resolution may be low definition (720p), etc.

[0060] In these implementation manners, for the image regions whose sorting positions satisfy the preset condition, high-definition or ultra-high-definition videos can always be transmitted. For those whose sorting positions do not satisfy the preset condition, it is necessary to switch between high definition and low definition according to whether they are within the field of view. Compared with the transmission method that does not consider the quantization parameter and only switches between high definition and low definition according to the scope of the career, since high-definition or ultra-high-definition videos are transmitted for most image regions, the switching delay can be minimized. In addition, for most image regions, there is no need to save data of multiple resolutions at the same time, reducing the occupancy of storage space.

[0061] Further refer to Figure 5 , as an implementation of the methods shown in the above figures, some embodiments of a video data transmission device are provided in the present disclosure, and these device embodiments correspond to Figure 2 the method embodiments shown, and the device can be specifically applied to various electronic devices.

[0062] As Figure 5 shown, some embodiments of the video data transmission device 500 include: an acquisition unit 501, a determination unit 502, and a transmission unit 503. Among them, the acquisition unit 501 is configured to acquire the video coding data after the target video is encoded. The target video corresponds to a plurality of image regions, and the plurality of image regions are obtained during the encoding process of the target video. The video coding data includes sub-data of at least one resolution corresponding to each of the plurality of image regions. The determination unit 502 is configured to determine the quantization parameter of each image region according to the current transmission mode. The transmission unit 503 is configured to transmit the sub-data of at least one resolution corresponding to the image region according to the quantization parameter of the image region for each image region.

[0063] In an alternative implementation of some embodiments, the determination unit 502 is further configured to: in response to the current transmission mode being the first transmission mode, determine the packet file corresponding to each image region within the target time period; for each image region, determine the average quantization parameter of the packet file corresponding to the image region, and use the average quantization parameter of the packet file as the quantization parameter of the image region.

[0064] In an alternative implementation of some embodiments, the determination unit 502 is further configured to: determine the mean value of the quantization parameters of each coding unit included in the packet file, and use the mean value as the average quantization parameter.

[0065] In an alternative implementation of some embodiments, the determination unit 502 is further configured to: in response to the current transmission mode being the second transmission mode, determine a plurality of coding units corresponding to each image region in the video frame group within the target time period; for each image region, determine the average quantization parameter of the plurality of coding units corresponding to the image region, and use the average quantization parameter of the plurality of coding units as the quantization parameter of the image region.

[0066] In an alternative implementation of some embodiments, the transmission unit 503 is further configured to: determine the sorting position of the quantization parameter of the image region among the quantization parameters corresponding to the plurality of image regions; based on the sorting position, transmit the sub-data of at least one resolution corresponding to the image region.

[0067] In an alternative implementation of some embodiments, the transmission unit 503 is further configured to: in response to the sorting position satisfying a preset condition, transmit the sub-data of the first resolution corresponding to the image region.

[0068] In an alternative implementation of some embodiments, the transmission unit 503 is further configured to: in response to determining that the sorting position does not meet the preset condition and the image area is within the current field of view, transmit the sub-data of the first resolution corresponding to the image area, where the current field of view is determined by the field of view parameters from the terminal.

[0069] In an alternative implementation of some embodiments, the transmission unit 503 is further configured to: in response to the sorting position not meeting the preset condition and the image area not being within the current field of view, transmit the sub-data of the second resolution corresponding to the image area.

[0070] It can be understood that the various units described in the apparatus 500 correspond to the respective steps in the method described with reference to Figure 2 Therefore, the operations, features, and beneficial effects described above for the method also apply to the apparatus 500 and the units included therein, and will not be elaborated herein.

[0071] Next, reference is made to Figure 6 , which shows a schematic structural diagram of an electronic device (such as Figure 1 the server in) 600 suitable for implementing some embodiments of the present disclosure. Figure 6 The electronic device shown is merely an example and should not impose any limitations on the functions and usage scope of the embodiments of the present disclosure.

[0072] As Figure 6 shown, the electronic device 600 may include a processing device (such as a central processing unit, a graphics processing unit, etc.) 601, which may perform various appropriate actions and processes according to the program stored in the read-only memory (ROM) 602 or the program loaded from the storage device 608 into the random access memory (RAM) 603. In the RAM 603, various programs and data required for the operation of the electronic device 600 are also stored. The processing device 601, the ROM 602, and the RAM 603 are connected to each other through a bus 604. The input / output (I / O) interface 605 is also connected to the bus 604.

[0073] Generally, the following devices may be connected to the I / O interface 605: an input device 606 including, for example, a touch screen, a touchpad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; an output device 607 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; a storage device 608 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 609. The communication device 609 may allow the electronic device 600 to communicate with other devices wirelessly or wiredly to exchange data. Although Figure 6An electronic device 600 with various devices is shown, but it should be understood that it is not required to implement or have all the shown devices. Instead, more or fewer devices may be implemented or had. Figure 6 Each block shown in [it] may represent a device or, as needed, multiple devices.

[0074] In particular, according to some embodiments of the present disclosure, the processes described above with reference to the flowcharts may be implemented as computer software programs. For example, some embodiments of the present disclosure include a computer program product that includes a computer program carried on a computer-readable medium, and the computer program contains program code for performing the methods shown in the flowcharts. In such some embodiments, the computer program may be downloaded and installed from a network via a communication device 609, or installed from a storage device 608, or installed from a ROM 602. When the computer program is executed by a processing device 601, the above functions defined in the methods of some embodiments of the present disclosure are performed.

[0075] It should be noted that the computer-readable medium described in some embodiments of the present disclosure may be a computer-readable signal medium or a computer-readable storage medium or any combination of the two. A computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the above. More specific examples of the computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In some embodiments of the present disclosure, the computer-readable storage medium may be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, apparatus, or device. And in some embodiments of the present disclosure, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, which carries computer-readable program code. Such a propagated data signal may take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. The computer-readable signal medium may also be any computer-readable medium other than the computer-readable storage medium, and the computer-readable signal medium may send, propagate, or transmit a program for use by or in conjunction with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium may be transmitted by any appropriate medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.

[0076] In some embodiments, the client and the server can communicate using any currently known or future-developed network protocol such as HTTP (HyperText Transfer Protocol), and can be interconnected with digital data communication in any form or medium (e.g., a communication network). Examples of communication networks include local area networks (“LANs”), wide area networks (“WANs”), the Internet (e.g., the Internet), and end-to-end networks (e.g., ad hoc end-to-end networks), as well as any currently known or future-developed networks.

[0077] The computer-readable medium described above can be included in the above-mentioned electronic device; it can also exist separately without being assembled into the electronic device. The computer-readable medium carries one or more programs. When the one or more programs are executed by the electronic device, the electronic device is caused to: obtain video coding data after encoding of a target video, where the target video corresponds to a plurality of image regions, and the plurality of image regions are obtained during the encoding process of the target video, and the video coding data includes sub-data of at least one resolution corresponding to each of the plurality of image regions; determine the quantization parameter of each image region according to the current transmission mode; for each image region, transmit the sub-data of at least one resolution corresponding to the image region according to the quantization parameter of the image region.

[0078] Computer program code for performing the operations of some embodiments of the present disclosure can be written in one or more programming languages or combinations thereof. The programming languages include object-oriented programming languages such as Java, Smalltalk, C++, and also include conventional procedural programming languages such as the “C” language or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, executed as an independent software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer can be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or can be connected to an external computer (e.g., by using an Internet service provider to connect through the Internet).

[0079] The flowcharts and block diagrams in the accompanying drawings illustrate the possible architectures, functions, and operations of systems, methods, and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagram may represent a module, a segment of a program, or a part of code that contains one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions marked in the blocks may occur in a different order than that marked in the accompanying drawings. For example, two consecutive blocks shown may actually be executed substantially in parallel, and they may sometimes be executed in the reverse order, depending on the functions involved. It should also be noted that each block in the block diagram and / or flowchart, as well as combinations of blocks in the block diagram and / or flowchart, can be implemented by a dedicated hardware-based system that performs the specified functions or operations, or can be implemented by a combination of dedicated hardware and computer instructions.

[0080] The units described in some embodiments of the present disclosure can be implemented in software or in hardware. The described units can also be provided in a processor. For example, it can be described as: a processor includes an acquisition unit, a determination unit, and a transmission unit. Among them, the names of these units do not constitute a limitation on the unit itself in some cases. For example, the acquisition unit can also be described as "the unit for acquiring the video coding data of the target video after encoding".

[0081] The functions described above can be performed at least in part by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that can be used include: Field Programmable Gate Arrays (FPGAs), Application Specific Integrated Circuits (ASICs), Application Specific Standard Products (ASSPs), Systems on Chip (SOCs), Complex Programmable Logic Devices (CPLDs), and so on.

[0082] The above description is only some preferred embodiments of the present disclosure and an explanation of the applied technical principles. Those skilled in the art should understand that the scope of the invention involved in the embodiments of the present disclosure is not limited to the technical solutions formed by the specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the above inventive concept. For example, the technical solutions formed by mutually replacing the above features with the (but not limited to) technical features with similar functions disclosed in the embodiments of the present disclosure.

Claims

1. A video data transmission method, comprising: obtaining video encoded data after encoding a target video, where the target video corresponds to multiple image regions, the multiple image regions are obtained during the encoding process of the target video, and the video encoded data includes sub-data of at least two resolutions respectively corresponding to the multiple image regions; determining a quantization parameter for each image region according to the current transmission mode; for each image region, transmitting sub-data of one resolution corresponding to the image region according to the quantization parameter of the image region; wherein, the transmitting sub-data of one resolution corresponding to the image region according to the quantization parameter of the image region includes: determining the sorting position of the quantization parameter of the image region among the quantization parameters respectively corresponding to the multiple image regions; based on the sorting position, transmitting sub-data of one resolution corresponding to the image region, including: in response to the sorting position satisfying a preset condition, transmitting sub-data of a first resolution corresponding to the image region; in response to the sorting position not satisfying the preset condition and the image region not being within the current field of view, transmitting sub-data of a second resolution corresponding to the image region, where the second resolution is less than the first resolution.

2. The method according to claim 1, wherein, the determining a quantization parameter for each image region according to the current transmission mode includes: in response to the current transmission mode being a first transmission mode, determining a packet file corresponding to each image region within a target time period; for each image region, determining the average quantization parameter of the packet file corresponding to the image region, and taking the average quantization parameter of the packet file as the quantization parameter of the image region.

3. The method according to claim 2, wherein, the determining the average quantization parameter of the packet file corresponding to the image region includes: determining the mean value of the quantization parameters of each coding unit included in the packet file corresponding to the image region, and taking the mean value as the average quantization parameter of the image region.

4. The method according to claim 1, wherein, the determining a quantization parameter for each image region according to the current transmission mode includes: in response to the current transmission mode being a second transmission mode, determining multiple coding units corresponding to each image region in a group of video frames within a target time period; for each image region, determining the average quantization parameter of the multiple coding units corresponding to the image region, and taking the average quantization parameter of the multiple coding units as the quantization parameter of the image region.

5. The method according to claim 4, wherein, the transmitting sub-data of one resolution corresponding to the image region based on the sorting position includes: in response to determining that the sorting position does not satisfy the preset condition and the image region is within the current field of view, transmitting sub-data of a first resolution corresponding to the image region, where the current field of view is determined by view parameters from a terminal.

6. A video data transmission device, comprising: An acquisition unit, configured to acquire video encoding data after encoding of a target video, where the target video corresponds to a plurality of image regions, the plurality of image regions are obtained during the encoding of the target video, and the video encoding data includes sub-data of at least two resolutions respectively corresponding to the plurality of image regions; A determination unit, configured to determine a quantization parameter of each image region according to a current transmission mode; A transmission unit, configured to, for each image region, transmit sub-data of one resolution corresponding to the image region according to the quantization parameter of the image region; Wherein, the transmitting the sub-data of one resolution corresponding to the image region according to the quantization parameter of the image region includes: Determining a sorting position of the quantization parameter of the image region among the quantization parameters respectively corresponding to the plurality of image regions; Based on the sorting position, the transmitting the sub-data of one resolution corresponding to the image region includes: In response to the sorting position satisfying a preset condition, transmitting the sub-data of a first resolution corresponding to the image region; In response to the sorting position not satisfying the preset condition and the image region not being within a current field of view, transmitting the sub-data of a second resolution corresponding to the image region, where the second resolution is less than the first resolution.

7. An electronic device, including: One or more processors; A storage device having stored thereon one or more programs, When the one or more programs are executed by the one or more processors, enabling the one or more processors to implement the method according to any one of claims 1-5.

8. A computer-readable medium having stored thereon a computer program, wherein, When the program is executed by a processor, implementing the method according to any one of claims 1-5.

Images