Video-aware communication using multiple transport blocks
By differentially classifying and assigning packets of streaming video content, generating and transmitting differentially protected transmission blocks, the problem of uneven video transmission quality in wireless communications is solved and the user experience quality is improved.
Patent Information
- Application Number
- CN202180025997.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2021-03-18
- Filing Date
- 2021-04-06
- Publication Date
- 2025-10-21
- Estimated Expiration
- 2041-04-06
AI Technical Summary
Existing wireless communication technologies have difficulty effectively distinguishing the impact of different groups on the quality of experience when transmitting streaming video content, resulting in uneven overall video transmission quality and an inability to provide differentiated protection.
By classifying multiple packets of streaming video content and assigning them to different data radio bearers (DRBs) based on the differences in video characteristics that affect the quality of experience, multiple transport blocks with differentiated protection are generated and provided for transmission.
It improves the transmission quality of streaming video content, ensures high-reliability transmission of key packets, and enhances the quality of user experience.
Smart Images

Figure CN115349259B_ABST
Abstract
Description
[0001] According to 35 Priority claims under USC § 119
[0002] This application claims claims from U.S. patent application No. 17 / 249,928, filed on March 18, 2021, entitled “VIDEO AWARE TRANSMISSION AND PROCESSING”; U.S. patent application No. 17 / 249,929, filed on March 18, 2021, entitled “VIDEO AWARE TRANSMISSION AND MULTIPLE INPUT MULTIPLE OUTPUT LAYERPROCESSING”; U.S. patent application No. 17 / 064,522, filed on October 6, 2020, entitled “VIDEO AWARE COMMUNICATION WITH MULTIPLE TRANSPORTBLOCKS”; U.S. patent application No. 17 / 064,522, filed on October 6, 2020, entitled “VIDEO AWARE TRANSMISSION AND MULTIPLE INPUT and 63 / 007,715, filed on April 9, 2020, entitled “VIDEO AWARE TRANSMISSION AND PROCESSING,” the entire contents of which are incorporated herein by reference.
[0003] public domain
[0004] Aspects of the present disclosure relate generally to wireless communications and, more particularly, to techniques and apparatus for video-aware communications and processing using multiple transport blocks.
[0005] background
[0006] Wireless communication systems are widely deployed to provide a variety of telecommunication services, such as telephony, video, data, messaging, and broadcasts. Typical wireless communication systems may employ multiple access technologies capable of supporting communication with multiple users by sharing available system resources (e.g., bandwidth, transmit power, etc.). Examples of such multiple access technologies include code division multiple access (CDMA) systems, time division multiple access (TDMA) systems, frequency division multiple access (FDMA) systems, orthogonal frequency division multiple access (OFDMA) systems, single-carrier frequency division multiple access (SC-FDMA) systems, time division synchronous code division multiple access (TD-SCDMA) systems, and long term evolution (LTE). LTE / LTE-Advanced is a set of enhancements to the Universal Mobile Telecommunications System (UMTS) mobile standard promulgated by the Third Generation Partnership Project (3GPP).
[0007] A wireless communication network may include several base stations (BSs) capable of supporting communications for several user equipment (UEs). User equipment (UEs) may communicate with the base stations (BSs) via downlinks and uplinks. The downlink (or forward link) refers to the communication link from the BS to the UE, while the uplink (or reverse link) refers to the communication link from the UE to the BS. As will be described in more detail herein, a BS may be referred to as a Node B, gNB, access point (AP), radio head, transmit / receive point (TRP), new radio (NR) BS, 5G Node B, and so on.
[0008] The above multiple access technologies have been adopted in various telecommunication standards to provide a common protocol that enables different user equipment to communicate at the city, country, region, and even global levels. New Radio (NR) (which may also be referred to as 5G) is a set of enhancements to the LTE mobile standard promulgated by the Third Generation Partnership Project (3GPP). NR is designed to better support mobile broadband Internet access by using orthogonal frequency division multiplexing (OFDM) (CP-OFDM) with a cyclic prefix (CP) on the downlink (DL), using CP-OFDM and / or SC-FDM (e.g., also known as discrete Fourier transform spread OFDM (DFT-s-OFDM)) on the uplink (UL), and supporting beamforming, multiple input multiple output (MIMO) antenna technology and carrier aggregation to improve spectrum efficiency, reduce costs, improve services, utilize new spectrum, and better integrate with other open standards. However, as the demand for mobile broadband access continues to grow, there is a need for further improvements to LTE and NR technologies. Preferably, these improvements should be applicable to other multiple access technologies and telecommunication standards that adopt these technologies.
[0009] Overview
[0010] In some aspects, a wireless communication method performed by a communication device may include: classifying multiple packets of streaming video content based at least in part on one or more video characteristics, wherein the one or more video characteristics are related to the impact of the packets on the quality of experience of providing the streaming video content; assigning the multiple packets to multiple data radio bearers (DRBs), wherein a first DRB of the multiple DRBs includes a first subset of the multiple packets and a second DRB of the multiple DRBs includes a second subset of the multiple packets, wherein the impact of the first subset of the multiple packets on the quality of experience is higher than the impact of the second subset of the multiple packets on the quality of experience; generating multiple transmission blocks, wherein a first transmission block of the multiple transmission blocks includes a first DRB and a second transmission block of the multiple transmission blocks includes a second DRB; and providing the multiple transmission blocks for transmission.
[0011] In some aspects, a communication device for wireless communication may include a memory and one or more processors operatively coupled to the memory. The memory and the one or more processors may be configured to: classify a plurality of packets of streaming video content based at least in part on one or more video characteristics, wherein the one or more video characteristics are related to an impact of the packets on a quality of experience of providing the streaming video content; assign the plurality of packets to a plurality of data radio bearers (DRBs), wherein a first DRB of the plurality of DRBs includes a first subset of the plurality of packets and a second DRB of the plurality of DRBs includes a second subset of the plurality of packets, wherein the impact of the first subset of the plurality of packets on the quality of experience is higher than the impact of the second subset of the plurality of packets on the quality of experience; generate a plurality of transport blocks, wherein a first transport block of the plurality of transport blocks includes a first DRB and a second transport block of the plurality of transport blocks includes a second DRB; and provide the plurality of transport blocks for transmission.
[0012] In some aspects, an apparatus for wireless communication may include: a device for classifying multiple packets of streaming video content based at least in part on one or more video characteristics, wherein the one or more video characteristics are related to the impact of the packets on the quality of experience of providing the streaming video content; a device for assigning the multiple packets to multiple data radio bearers (DRBs), wherein a first DRB of the multiple DRBs includes a first subset of the multiple packets and a second DRB of the multiple DRBs includes a second subset of the multiple packets, wherein the impact of the first subset of the multiple packets on the quality of experience is higher than the impact of the second subset of the multiple packets on the quality of experience; a device for generating multiple transport blocks, wherein a first transport block of the multiple transport blocks includes a first DRB and a second transport block of the multiple transport blocks includes a second DRB; and a device for providing the multiple transport blocks for transmission.
[0013] Aspects generally include methods, apparatus, systems, computer program products, non-transitory computer-readable media, user equipment, base stations, communication devices, and / or processing systems as substantially described herein with reference to and as illustrated in the figures, description, and appendices.
[0014] The foregoing has broadly outlined the features and technical advantages of examples according to the present disclosure in an effort to make the following detailed description better understood. Additional features and advantages will be described hereinafter. The concepts and specific examples disclosed can be readily used as a basis for modifying or designing other structures for implementing the same purposes as the present disclosure. Such equivalent constructions do not depart from the scope of the appended claims. The characteristics of the concepts disclosed herein, both in terms of their organization and method of operation, as well as the associated advantages, will be better understood by considering the following description in conjunction with the accompanying drawings. Each of the figures is provided for illustration and description purposes and is not intended to define limitations on the claims. BRIEF DESCRIPTION OF THE DRAWINGS
[0016] In order to understand in detail the features of the present disclosure set forth above, a more particular description of the content briefly summarized above may be obtained with reference to various aspects, some of which are illustrated in the accompanying drawings. It should be noted, however, that the accompanying drawings illustrate only certain typical aspects of the present disclosure and are not to be considered limiting of its scope, as the description may admit to other equally effective aspects. The same reference numerals in different drawings may identify the same or similar elements.
[0017] Figure 1 is a block diagram conceptually illustrating an example of a wireless communication network in accordance with various aspects of the present disclosure.
[0018] Figure 2 is a block diagram conceptually illustrating an example of a base station and a UE in communication in a wireless communication network according to various aspects of the present disclosure.
[0019] Figure 3 is a block diagram conceptually illustrating an example of a wireless communication network in which a BS provides streaming video to a UE in accordance with various aspects of the present disclosure.
[0020] Figure 4A and 4B is a block diagram conceptually illustrating block generation by a communication device to enable a BS to provide streaming video to a UE in accordance with various aspects of the present disclosure.
[0021] Figure 5 is a block diagram conceptually illustrating data processing by a communication device to enable a BS to provide streaming video to a UE in accordance with various aspects of the present disclosure.
[0022] Figure 6is an illustration of a system including devices supporting video-aware communication using multiple transport blocks in accordance with aspects of the present disclosure.
[0023] Figure 7 is a diagram illustrating example processes, eg, performed by a wireless device, in accordance with various aspects of the present disclosure.
[0024] Detailed description
[0025] The various aspects of the present disclosure are described more fully below with reference to the accompanying drawings. However, the present disclosure can be implemented in many different forms and should not be interpreted as being limited to any specific structure or function given throughout the present disclosure. Specifically, these aspects are provided to make the present disclosure thorough and complete, and they will fully convey the scope of the present disclosure to those skilled in the art. Based on the teachings herein, those skilled in the art will appreciate that the scope of the present disclosure is intended to cover any aspect of the present disclosure disclosed herein, regardless of whether it is implemented independently or in combination with any other aspect of the present disclosure. For example, any number of aspects set forth herein can be used to implement a device or practice method. In addition, the scope of the present disclosure is intended to cover such devices or methods that are practiced using a supplement to the various aspects of the disclosure set forth herein or other other structures, functionality, or structure and functionality. It should be understood that any aspect of the present disclosure disclosed herein can be implemented by one or more elements of the claims.
[0026] Several aspects of telecommunications systems will now be presented with reference to various devices and techniques. These devices and techniques are described in the following detailed description and illustrated in the accompanying drawings by various blocks, modules, components, circuits, steps, processes, algorithms, etc. (collectively referred to as "elements"). These elements can be implemented using hardware, software, or a combination thereof. Whether such elements are implemented as hardware or software depends on the specific application and the design constraints imposed on the overall system.
[0027] It should be noted that although various aspects may be described herein using terminology generally associated with 3G and / or 4G wireless technologies, various aspects of the present disclosure may be applicable in communication systems based on other generations, such as 5G and later generations, including NR technology.
[0028] Figure 11 is a diagram illustrating a wireless network 100 in which various aspects of the present disclosure may be practiced. The wireless network 100 may be an LTE network or some other wireless network, such as a 5G or NR network. The wireless network 100 may include several base stations 110 (shown as BS 110a, BS 110b, BS 110c, and BS 110d) and other network entities. A base station is an entity that communicates with user equipment (UE) and may also be referred to as a base station, NR base station, node B, gNB, 5G node B (NB), access point, transmit reception point (TRP), etc. Each base station may provide communication coverage for a specific geographic area. In 3GPP, the term "cell" may refer to the coverage area of a base station and / or the base station subsystem serving that coverage area, depending on the context in which the term is used.
[0029] A BS may provide communication coverage for a macro cell, a pico cell, a femto cell, and / or another type of cell. A macro cell may cover a relatively large geographic area (e.g., several kilometers in radius) and may allow unrestricted access by UEs with service subscriptions. A pico cell may cover a relatively small geographic area and may allow unrestricted access by UEs with service subscriptions. A femto cell may cover a relatively small geographic area (e.g., a residence) and may allow restricted access by UEs associated with the femto cell (e.g., UEs in a closed subscriber group (CSG)). A BS for a macro cell may be referred to as a macro BS. A BS for a pico cell may be referred to as a pico BS. A BS for a femto cell may be referred to as a femto BS or a home BS. In Figure 1 In the example shown in FIG, BS 110a may be a macro BS for macro cell 102a, BS 110b may be a pico BS for pico cell 102b, and BS 110c may be a femto BS for femto cell 102c. A BS may support one or more (e.g., three) cells. The terms "eNB," "base station," "NR BS," "gNB," "TRP," "AP," "Node B," "5G NB," and "cell" may be used interchangeably herein.
[0030] In some aspects, the cells may not necessarily be stationary, and the geographic area of the cells may move depending on the location of the mobile BS. In some aspects, the BSs may interconnect with each other and / or with one or more other BSs or network nodes (not shown) in the wireless network 100 via various types of backhaul interfaces (such as direct physical connections, virtual networks, etc.) using any suitable transport network.
[0031] The wireless network 100 may also include a relay station. A relay station is an entity that can receive transmissions of data from an upstream station (e.g., a BS or a UE) and send transmissions of the data to a downstream station (e.g., a UE or a BS). A relay station may also be a UE that can relay transmissions for other UEs. Figure 1 In the example shown in , relay station 110d may communicate with macro BS 110a and UE 120d to facilitate communication between BS 110a and UE 120d. A relay station may also be referred to as a relay BS, relay base station, relay, or the like.
[0032] The wireless network 100 may be a heterogeneous network including different types of BSs (e.g., macro BSs, pico BSs, femto BSs, relay BSs, etc.). These different types of BSs may have different transmit power levels, different coverage areas, and different impacts on interference in the wireless network 100. For example, a macro BS may have a high transmit power level (e.g., 5 to 40 watts), while a pico BS, a femto BS, and a relay BS may have a lower transmit power level (e.g., 0.1 to 2 watts).
[0033] The network controller 130 may be coupled to a set of BSs and may provide coordination and control of these BSs. The network controller 130 may communicate with each BS via a backhaul. These BSs may also communicate with each other directly or indirectly, for example, via a wireless or wired backhaul.
[0034] UEs 120 (e.g., 120a, 120b, 120c) may be dispersed throughout the wireless network 100, and each UE may be stationary or mobile. A UE may also be referred to as an access terminal, terminal, mobile station, subscriber unit, station, etc. A UE may be a cellular phone (e.g., a smartphone), a personal digital assistant (PDA), a wireless modem, a wireless communication device, a handheld device, a laptop computer, a cordless phone, a wireless local loop (WLL) station, a tablet, a camera, a gaming device, a netbook, a smartbook, an ultrabook, a medical device or equipment, a biometric sensor / device, a wearable device (e.g., a smart watch, smart clothing, smart glasses, a smart wristband, smart jewelry (e.g., a smart ring, a smart bracelet)), an entertainment device (e.g., a music or video device, or a satellite radio), a vehicle component or sensor, a smart meter / sensor, industrial manufacturing equipment, a global positioning system device, or any other suitable device configured to communicate via a wireless or wired medium.
[0035] Some UEs may be considered machine type communication (MTC) UEs, or evolved or enhanced machine type communication (eMTC) UEs. MTC and eMTC UEs include, for example, robots, drones, remote devices, sensors, meters, monitors, location tags, and the like, which can communicate with a base station, another device (e.g., a remote device), or some other entity. A wireless node may provide connectivity to or to a network (e.g., a wide area network (such as the Internet) or a cellular network), for example, via a wired or wireless communication link. Some UEs may be considered Internet of Things (IoT) devices and / or may be implemented as NB-IoT (Narrowband Internet of Things) devices. Some UEs may be considered customer premises equipment (CPE). UE 120 may be included within a housing that houses components of UE 120, such as a processor component, a memory component, and the like. In some aspects, the processor component and the memory component may be coupled together. For example, the processor component (e.g., one or more processors) and the memory component (e.g., memory) may be operatively coupled, communicatively coupled, electronically coupled, electrically coupled, and the like.
[0036] In general, any number of wireless networks may be deployed in a given geographic area. Each wireless network may support a specific radio access technology (RAT) and may operate on one or more frequencies. A RAT may also be referred to as a radio technology, air interface, etc. A frequency may also be referred to as a carrier, frequency channel, etc. Each frequency may support a single RAT in a given geographic area to avoid interference between wireless networks of different RATs. In some cases, NR or 5G RAT networks may be deployed.
[0037] In some aspects, two or more UEs 120 (e.g., shown as UE 120a and UE 120e) may communicate directly (e.g., without using base station 110 as an intermediary) using one or more sidelink channels. For example, the UEs 120 may communicate using peer-to-peer (P2P) communication, device-to-device (D2D) communication, vehicle-to-everything (V2X) protocols (e.g., which may include vehicle-to-vehicle (V2V) protocols, vehicle-to-infrastructure (V2I) protocols, etc.), mesh networks, etc. In this scenario, the UEs 120 may perform scheduling operations, resource selection operations, and / or other operations described elsewhere herein as being performed by the base station 110. As indicated above, Figure 1 are provided as examples. Other examples may differ from those described in Figure 1 Examples described.
[0038] Figure 2 A block diagram shows a design 200 of a base station 110 and a UE 120, which may be Figure 1One for each base station and one for each UE in . Base station 110 may be equipped with T antennas 234a through 234t, and UE 120 may be equipped with R antennas 252a through 252r, where in general T≧1 and R≧1.
[0039] At base station 110, transmit processor 220 may receive data for one or more UEs from data source 212, select one or more modulation and coding schemes (MCS) for each UE based at least in part on a channel quality indicator (CQI) received from the UE, process (e.g., encode and modulate) the data for each UE based at least in part on the MCS selected for the UE, and provide data symbols for all UEs. Transmit processor 220 may also process system information (e.g., for semi-static resource partitioning information (SRPI)) and control information (e.g., CQI requests, grants, upper layer signaling, etc.), and provide overhead symbols and control symbols. Transmit processor 220 may also generate reference symbols for reference signals (e.g., a cell-specific reference signal (CRS)) and synchronization signals (e.g., a primary synchronization signal (PSS) and a secondary synchronization signal (SSS)). A transmit (TX) multiple-input, multiple-output (MIMO) processor 230 may perform spatial processing (e.g., precoding) on data symbols, control symbols, overhead symbols, and / or reference symbols, as applicable, and may provide T output symbol streams to T modulators (MODs) 232a through 232t. Each modulator 232 may process a respective output symbol stream (e.g., for OFDM, etc.) to obtain an output sample stream. Each modulator 232 may further process (e.g., convert to analog, amplify, filter, and frequency upconvert) the output sample stream to obtain a downlink signal. The T downlink signals from modulators 232a through 232t may be transmitted via T antennas 234a through 234t, respectively. According to various aspects described in greater detail below, position coding may be utilized to generate synchronization signals to convey additional information.
[0040] At UE 120, antennas 252a through 252r may receive downlink signals from base station 110 and / or other base stations and may provide received signals to demodulators (DEMODs) 254a through 254r, respectively. Each demodulator 254 may condition (e.g., filter, amplify, downconvert, and digitize) the received signal to obtain input samples. Each demodulator 254 may further process the input samples (e.g., for OFDM, etc.) to obtain received symbols. A MIMO detector 256 may obtain received symbols from all R demodulators 254a through 254r, perform MIMO detection on the received symbols where applicable, and provide detected symbols. A receive processor 258 may process (e.g., demodulate and decode) the detected symbols, provide decoded data for UE 120 to a data receiver 260, and provide decoded control information and system information to a controller / processor 280. The channel processor may determine reference signal received power (RSRP), received signal strength indicator (RSSI), reference signal received quality (RSRQ), channel quality indicator (CQI), etc. In some aspects, one or more components of UE 120 may be included in a housing.
[0041] On the uplink, at the UE 120, a transmit processor 264 may receive and process data from a data source 262 and control information (e.g., for reports including RSRP, RSSI, RSRQ, CQI, etc.) from the controller / processor 280. The transmit processor 264 may also generate reference symbols for one or more reference signals. The symbols from the transmit processor 264 may be precoded by a TX MIMO processor 266, if applicable, further processed by modulators 254a through 254r (e.g., for DFT-s-OFDM, CP-OFDM, etc.), and transmitted to the base station 110. At the base station 110, uplink signals from the UE 120 and other UEs may be received by the antenna 234, processed by the demodulator 232, detected by the MIMO detector 236, if applicable, and further processed by the receive processor 238 to obtain decoded data and control information sent by the UE 120. The receive processor 238 may provide the decoded data to the data receiver 239 and the decoded control information to the controller / processor 240. The base station 110 may include a communication unit 244 and communicate with the network controller 130 via the communication unit 244. The network controller 130 may include a communication unit 294, a controller / processor 290, and a memory 292.
[0042] The controller / processor 240 of the base station 110, the controller / processor 280 of the UE 120, and / or Figure 2Any other component(s) of the base station 110 may perform one or more techniques associated with video-aware multiplexing, as described in more detail elsewhere herein. For example, the controller / processor 240 of the base station 110, the controller / processor 280 of the UE 120, and / or Figure 2 Any other component of the may perform or direct e.g. Figure 7 700 and / or other processes as described herein. Memories 242 and 282 may store data and program codes for base station 110 and UE 120, respectively. In some aspects, memory 242 and / or memory 282 may include a non-transitory computer-readable medium storing one or more instructions for wireless communication. For example, the one or more instructions, when executed (e.g., directly, or after compilation, conversion, interpretation, etc.) by one or more processors of base station 110 and / or UE 120, may perform or direct, for example, Figure 7 The process 700 and / or operations of other processes as described herein. In some aspects, executing instructions may include running instructions, converting instructions, compiling instructions, interpreting instructions, etc. The scheduler 246 may schedule UEs for data transmission on the downlink and / or uplink.
[0043] In some aspects, a communication device (e.g., BS 110 or a video processing component thereof) may include means for classifying a plurality of packets of streaming video content based at least in part on one or more video characteristics, wherein the one or more video characteristics are related to the impact of the packets on the quality of experience of providing the streaming video content. The communication device may further include means for assigning the plurality of packets to a plurality of data radio bearers (DRBs). For example, a first DRB may include a first subset of the plurality of packets, and a second DRB may include a second subset of the plurality of packets, wherein the first subset of the plurality of packets has a higher impact on the quality of experience than the second subset of the plurality of packets. The communication device may include means for generating a plurality of transport blocks. For example, a first transport block of the plurality of transport blocks may include a first DRB, and a second transport block of the plurality of transport blocks may include a second DRB. The communication device may further include means for providing the plurality of transport blocks for transmission, etc. In some aspects, such means may include means for combining Figure 2 One or more components of the BS 110 are depicted, such as antenna 234, DEMOD 232, MIMO detector 236, receive processor 238, controller / processor 240, transmit processor 220, TX MIMO processor 230, MOD 232, antenna 234, etc. As indicated above, Figure 2 are provided as examples. Other examples may differ from those described in Figure 2 Examples described.
[0044] Figure 3 1 is a block diagram conceptually illustrating an example of a wireless communication network 300 in which a BS (e.g., BS 110) provides streaming video to a UE (e.g., UE 120) in accordance with various aspects of the present disclosure. Figure 3 As shown in FIG, the wireless communication network 300 may include an Internet Protocol (IP) multimedia core network subsystem (IMS) core 305, a packet data network gateway (PGW) 310, a serving gateway (SGW) 315, a BS 110 (which may include a communication device 320, for example), and a UE 120. Figure 3 As further shown in , BS 110 and UE 120 may communicate via an access link (eg, a Uu interface).
[0045] The PGW 310 includes one or more devices capable of providing connectivity to external packet data networks for the UE 120 (e.g., via the IMS core 305). For example, the PGW 310 may include one or more data processing and / or traffic transmission devices, such as a gateway, a router, a modem, a switch, a firewall, a network interface card (NIC), a hub, a bridge, a server device, an optical add / drop multiplexer (OADM), or any other type of device that processes and / or transmits traffic. In some implementations, the PGW 310 may aggregate traffic received from one or more SGWs 315 and may send the aggregated traffic to the IMS core 305. Additionally or alternatively, as described in greater detail herein, the PGW 310 may receive traffic from the IMS core 305 and may send the traffic to the UE 120 via the SGW 315 and the BS 110. For example, the PGW 310 may receive a video stream from the IMS core 305, which will be provided to the BS 110 for processing and transmission to the UE 120.
[0046] The SGW 315 includes one or more devices capable of routing packets. For example, the SGW 315 may include one or more data processing and / or traffic transmission devices, such as a gateway, a router, a modem, a switch, a firewall, a NIC, a hub, a bridge, a server device, an OADM, or any other type of device that processes and / or transmits traffic. In some implementations, the SGW 315 may aggregate traffic received from one or more BSs 110 associated with the wireless communication network 300 and may send the aggregated traffic to the IMS core 305 (e.g., via the PGW 310) and / or other network devices. The SGW 315 may receive traffic from the IMS core 305 (e.g., via the PGW 310) and / or other network devices and may send the received traffic to the BS 110 for processing and transmission to the UE 120. For example, the SGW 315 may receive Real-time Transport Protocol (RTP) data having a real-time transport protocol (RTP) payload format such as, for example, H.263, H.264, or H.265 and / or Real-time Control Transport Protocol (RTCP) data (e.g., RTP data conveying streaming video via General Packet Radio Service (GPRS) Tunneling Protocol (GTP)). In this case, the SGW 315 may provide the RTP data and / or RTCP data (e.g., streaming video) to the BS 110 via GTP and RTP and / or RTCP.
[0047] In some communication systems, such as 5G / NR Video Bearer (VoNR) or LTE Video Bearer (ViLTE), a base station (BS) and a user equipment (UE) can communicate using full-duplex voice and simplex or full-duplex video streaming. The BS and the UE can achieve a relatively high level of synchronization between the voice and video streams (which may be collectively referred to as streaming content), enabling video calls, streaming entertainment, and the like. The BS can activate dedicated bearers for transporting video and audio RTP traffic. The BS can assign different Quality of Service (QoS) levels to video (e.g., assigning QoS Class Identifier (QCI) 2 to video) and audio (e.g., assigning QCI 1 to audio), thereby providing some differentiation in terms of reliability. For example, in this scenario, the BS prioritizes streaming audio, which may be delay- and jitter-sensitive, over streaming video, which may be less delay- or jitter-sensitive. In other words, during a video conferencing use case, a brief interruption in the audio from a speaker may be more disruptive to the video conference than a brief interruption in the speaker's video.
[0048] However, at the media access control (MAC) or physical (PHY) layer, the BS can perform procedures such as scheduling, decoding, modulation, multiplexing, and orthogonal frequency division multiplexing (OFDM) symbol generation, regardless of the data being processed. In other words, the BS can process all data in a video stream without considering which part of the video stream the data represents. As a result, when an interruption in data transmission affects a portion of the video stream with a greater quality of experience (QoE) impact, the interruption can cause a disproportionate impact on QoE.
[0049] Some aspects described herein provide video-aware processing for streaming video. For example, as described below, a communication device (e.g., a BS or a component of a BS) may classify portions of a streaming video based at least in part on the impact of each portion of the streaming video on the QoE of the streaming video, and may provide differential protection to the portions based at least in part on the classification. In other words, the communication device may assign different portions of the streaming video to different code blocks and / or transport blocks based at least in part on the classification. For example, the communication device may generate a first data stream for header data (e.g., RTP, User Datagram Protocol (UDP), IP header data), a second data stream for transparent operation, a third data stream for a first QoS classification, a fourth data stream for a second QoS classification, and so on.
[0050] The communication device 320 may include the BS 110 or a component of the BS 110. For example, the communication device 320 may be a video processing component that includes one or more of the controller / processor 240, transmit processor 220, TX MIMO processor 230, MOD 232, antenna 234, etc. of the BS 110. Figure 3 As shown in , BS 110 can decompose and / or transcode received packets (e.g., packets received from SGW 315) to identify underlying aspects of the data, such as different aspects of streaming video (e.g., different video aspects, different audio aspects, etc.), as described in more detail herein. In this scenario, based on received RTP data (e.g., RTP H.264 payload data), the communication device 320 can assign portions of the received data to different code blocks and / or transport blocks, provide different qualities of service to the different code blocks and / or transport blocks, and provide data radio bearer (DRB) sets based on the different code blocks and / or transport blocks. In this scenario, BS 110 can provide video-aware DRBs and RTCP output data to UE 120 over the Uu interface.
[0051] The communication device (e.g., communication device 320) may provide differential protection for different code blocks and / or transport blocks. In some aspects, the communication device may provide differential protection or reliability for different code blocks and / or transport blocks based on the data flow within the code blocks and / or transport blocks (e.g., the data stream comprising them). For example, the communication device may classify a portion of the data stream (e.g., a plurality of packets of video streaming data). The classification may be based on one or more video characteristics related to the impact of the packets on the quality of experience provided by the streaming video content. The one or more video characteristics may relate to video frame type information, such as intra picture frames (I-frames), predicted picture frames (P-frames), or bidirectionally predicted picture frames (B-frames), or time-to-frequency transforms (e.g., discrete cosine transform (DCT) coefficients). Alternatively, when packets are damaged or lost during transmission, the impact of the packets on the quality of experience of the video stream may be determined based on the degree of quality degradation, whether objective or subjective.
[0052] The communication device may classify the plurality of packets of the streaming video content into at least a first subset and a second subset based on their impact on a difference in quality of experience. In one implementation, the communication device may classify the packets such that the first subset of packets may include packets whose impact on quality of experience is higher than the impact of packets included in the second subset of packets on quality of experience. For example, the first subset of packets may include only I-frame video packets, while the second subset of packets may include P-frame and / or B-frame video packets.
[0053] The communication device may assign a plurality of packets to a plurality of data radio bearers (DRBs). For example, the communication device may assign a first subset of packets to a first DRB and a second subset of packets to a second DRB, wherein the first subset of the plurality of packets has a higher impact on quality of experience than the second subset of the plurality of packets.
[0054] The communication device may generate a plurality of transport blocks and provide the plurality of transport blocks for transmission. In one aspect, the communication device may generate a first transport block including a first DRB and a second transport block including a second DRB. A transport block may refer to a block of data transferred between the MAC layer and the physical layer. It is transferred downward at the transmitter and upward at the receiver. The transport block undergoes physical layer processing at the transmitter and is then mapped to a physical channel (e.g., PDSCH) for transmission across the air interface.
[0055] The communications device may provide multiple transport blocks for transmission. In one aspect, the communications device may provide the multiple transport blocks for transmission by applying a first redundancy to a first transport block including a first DRB and applying a second redundancy to a second transport block including a second DRB. For example, the first redundancy may be higher than the second redundancy, or the first redundancy may be the same as or lower than the second redundancy. On the other hand, applying different redundancy levels to transport blocks may result in different code rates, even if the transport blocks are the same size. For example, applying a higher redundancy to a first transport block may result in a lower code rate (i.e., adding more redundant data so that there is reduced transmission capacity for the actual information bits of the first transport block), or applying a lower redundancy to a second transport block may result in a higher code rate (i.e., adding less redundant data so that there is increased transmission capacity for the actual information bits of the second transport block). Additionally or alternatively, adding a higher (or lower) redundancy to a transport block may indicate applying a higher (or lower) modulation scheme (e.g., modulating using a higher (or lower) modulation order) to the transport block and / or applying a more robust (or less robust) channel coding scheme.
[0056] In another aspect, the communications device may provide a plurality of transport blocks for transmission by assigning a different quality of service (QoS) level to each of the plurality of transport blocks. The communications device may assign a first QoS level to a first transport block and a second QoS level to a second transport block. In one implementation, a first QoS level assigned to a first transport block including a first DRB may be higher than a second QoS level assigned to a second transport block including a second DRB. In another implementation, assigning a higher QoS level to a transport block may be used interchangeably with assigning a higher redundancy to a transport block.
[0057] UE 120 may receive video-aware DRBs and RTCP output data via the Uu interface. UE 120 may reconstruct the underlying RTP data (e.g., RTP H.264 payload data) and process the underlying RTP data using a video decoder (e.g., RTP H.264 decoder) to obtain a decoded video stream. As indicated above, Figure 3 are provided as examples. Other examples may differ from those described in Figure 3 Examples described.
[0058] Figure 4A and 4B are diagrams illustrating examples 400 , 450 of block generation by a communication device to enable a BS to provide streaming video to a UE in accordance with various aspects of the present disclosure.
[0059] like Figure 4AAs shown in , a medium access control (MAC) entity of a communication device may generate a transport block (e.g., based at least in part on a service data adaptation protocol (SDAP) block generation, a packet data convergence protocol (PDCP) block generation, and a radio link control (RLC) block generation). For example, the MAC entity may concatenate two RLC protocol data units (PDUs) from a first radio bearer (RBx) 410 and one RLC PDU from a second radio bearer (RBy) 420. After concatenation, the communication device may add cyclic redundancy check (CRC) bits 425 and divide the transport block into a plurality of code blocks. In this case, a first code block 430 includes only data of the first radio bearer 410, while a second code block 440 includes, for example, data 441 of the first radio bearer 410 and data 442 of the second radio bearer 420. As a result, based at least in part on data from a plurality of DRBs being multiplexed into a common code block 440, the communication device (e.g., via a MAC entity or a PHY entity) provides the same QoS (e.g., the QoS of the common code block) for each radio bearer.
[0060] On the contrary, Figure 4B As shown in , a communication device (e.g., BS 110, communication device 320, etc.) may include a MAC entity that may determine a code block size 450. A code block size according to the present disclosure may refer to a code block size used for channel decoding. Channel decoding within a PHY entity requires that the code block have a specific size and not exceed a maximum code block size. In some implementations, a transport block including one or more MAC service data units (SDUs) and a CRC may be segmented into code block sizes (if required). The MAC entity may determine the code block size 450 based on information from other entities, such as, for example, a PHY entity or other higher entity. In this case, based at least in part on determining the code block size, the MAC entity of the communication device may allocate the RLC PDU into code block size units so that different code blocks can be mapped to obtain different QoS, such as with respect to Figure 4A Additionally or alternatively, the RLC entity may segment an RLC SDU (e.g., a data block unit input to the RLC entity) into a plurality of segmented RLC SDUs based on a code block size 450. For example, the RLC entity may segment a regular-sized RLC SDU into a first RLC SDU segment 451 and a second RLC SDU segment 452 based on the code block size so that the MAC entity may allocate an RLC PDU (e.g., a MAC SDU) to the code block size by concatenating the regular-sized first MAC SDU with a smaller-sized second MAC SDU 460 including the segmented RLC SDU segment (e.g., SDU segment #1 451).
[0061] In some aspects, such as Figure 4BAs shown in , a first code block 480 includes only data from a first radio bearer (e.g., RBx 410), while a second code block 490 includes only data from a second radio bearer (e.g., RBy 420). In this case, the communications device may include padding bits to enable the data of the radio bearers to fill the entire code block. In this way, based at least in part on ensuring that each radio bearer is in a code block separate from every other radio bearer, the communications device implements QoE-based video-aware processing without requiring changes to the Layer 1 (L1) block generation procedure. In some implementations, as indicated above, Figure 4A and 4B are provided as examples. Other examples may differ from those described in Figure 4A and Figure 4B Examples described.
[0062] Figure 5 is a diagram illustrating an example 500 of data processing by a communication device to enable a BS to provide streaming video to a UE in accordance with various aspects of the present disclosure.
[0063] Video encoders (such as H.263, H.264, H.265, VP9, or AV1) exploit redundancy between video frames (e.g., inter-frame redundancy) and / or redundancy within video frames (e.g., intra-frame redundancy) to achieve efficient and high-quality video compression. Highly compressed video encoded streams include multiple video encoded components. These video streams are susceptible to even small amounts of packet loss due to communication channel errors to varying degrees, depending on the location of the video encoded components. In other words, transmission errors occurring in certain fields within the video stream may cause more quality degradation to the overall video quality than other fields within the video stream.
[0064] In some examples, DCT or any other similar time-to-frequency transform (such as inverse DCT (IDCT) or modified DCT (MDCT)) has been frequently used for image compression and video compression for decades due to various excellent properties associated with their output transform coefficients. For example, it is a well-known principle that lower-frequency DCT coefficients are more important than higher-frequency DCT coefficients in terms of their impact on video quality experience.
[0065] In another example, many advanced video compression algorithms apply different algorithms based on picture type or frame type. The three main video frame types used in video compression are I-frames, P-frames, and B-frames. I-frames generally do not utilize inter-frame redundancy and are therefore generally the least compressible of these frames. However, I-frames can have a higher impact on the video quality of experience because I-frames are generally used as reference frames for P-frames or B-frames. P-frames can use data from previous frames (e.g., typically from previous I-frames) for decompression and are more compressible than I-frames. B-frames can use previous (e.g., typically from previous I-frames) and forward frames (e.g., typically from forward P-frames) for data reference to achieve the highest data compression.
[0066] The communication device may determine that a first code block (or transport block) among the plurality of code blocks (or transport blocks) may include a first subset of the plurality of video packets, and a second code block (or transport block) among the plurality of code blocks (or transport blocks) may include a second subset of the plurality of video packets. The communication device may further determine that the first subset of the plurality of video packets may have a higher impact on the quality of service experience than the second subset of the plurality of video packets. As a non-limiting example, the first subset of the plurality of video packets may include compressed video data associated with I-frames, and the second subset of the plurality of video packets may include compressed video data associated with P-frames or B-frames.
[0067] A communication device may decompose streaming content (e.g., streaming video) into multiple portions associated with different characteristics to enable the provision of video-aware DRBs. In some aspects, the communication device (e.g., BS 110, communication device 320) may classify the portions of the streaming content based, at least in part, on one or more video characteristics. The one or more video characteristics may be related to the impact of the packet on providing a quality of experience for the streaming video content. For example, the communication device (e.g., BS 110, communication device 320) may classify a portion of a data stream (e.g., multiple packets of video streaming data). The classification may be based on one or more video characteristics related to the impact of the packet on providing a quality of experience for the streaming video content. The one or more video characteristics may be related to video frame type information (such as I-frame, P-frame, or B-frame) or time-to-frequency transform (e.g., DCT or discrete Fourier transform (DFT) coefficients). Alternatively, when packets are damaged or lost during transmission, the impact of the packet on the quality of experience of the video stream may be determined based on the degree of quality degradation, whether objective or subjective.
[0068] The communication device may classify the plurality of packets of the streaming video content into at least a first subset and a second subset based on their impact on the quality of experience difference. In one implementation, the communication device (e.g., BS 110, communication device 320) may classify the packets in such a manner that the first subset of packets may include packets whose impact on the quality of experience is higher than the impact of the packets included in the second subset of packets on the quality of experience. For example, the first subset of packets may include only I-frame video packets, while the second subset of packets may include P-frame and / or B-frame video packets. In some aspects, such as Figure 5 As shown in , the communication device may perform the classification based on I-frame category 501, P-frame category 503, or B-frame category 502. These are merely examples of categories that may be used. In practice, the communication device may classify streaming content based on one or more other heuristic types or one or more video characteristics that may have different impacts on the video quality of experience.
[0069] The communication device may assign different portions of the streaming content to different DRBs for further downstream processing (e.g., for transport block cyclic redundancy check (CRC) attachment, code block segmentation, channel decoding, rate matching, code block concatenation, etc., as described in more detail herein). In one implementation, the communication device (e.g., BS 110, communication device 320) may assign a first subset of packets to a first DRB 511 and a second subset of packets to a second DRB 512 513. Assigning the first subset of packets and the second subset of packets to the first DRB and the second DRB, respectively, may be performed based on a difference in their impact on the quality of experience. For example, the first subset of the plurality of packets may have a higher impact on the quality of experience than the second subset of the plurality of packets.
[0070] The communication device may generate multiple transport blocks and provide the multiple transport blocks for transmission. For example, the communication device (e.g., BS 110, communication device 320) may generate a first transport block including a first DRB 511 and a second transport block including a second DRB 512. In one implementation, based at least in part on processing the multiple DRBs 511 512 513, the communication device (e.g., BS 110, communication device 320) may attach a CRC to each transport block of each DRB during the CRC attachment phase 505 535 565 to provide error detection capabilities. The receiving communication device (e.g., UE 120) may use the CRC bits to determine whether the received transport block includes any bit errors introduced during the wireless transmission of the video stream.
[0071] The communications device may provide the plurality of transport blocks for transmission by applying a first redundancy to a first transport block including a first DRB and applying a second redundancy to a second transport block including a second DRB.
[0072] The first redundancy may be higher than the second redundancy, or the first redundancy may be the same as or lower than the second redundancy. In one implementation, adding higher (or lower) redundancy to a transport block indicates adding more (or less) redundant data (e.g., cyclic redundancy check (CRC) bits) to the transport block. On the other hand, applying different redundancy levels to transport blocks may result in different code rates, even if the transport blocks are the same size. For example, applying higher redundancy to a first transport block may result in a lower code rate (i.e., adding more redundant data so that there is reduced transmission capacity for the actual information bits of the first transport block), or applying lower redundancy to a second transport block may result in a higher code rate (i.e., adding less redundant data so that there is increased transmission capacity for the actual information bits of the second transport block). Additionally or alternatively, adding higher (or lower) redundancy to a transport block may indicate applying a higher (or lower) modulation scheme to the transport block (e.g., modulating using a higher (or lower) modulation order 591) and / or applying a more robust (or less robust) channel coding scheme 515.
[0073] In some aspects, based at least in part on processing the plurality of DRBs, the communications device may optionally segment at least some transport blocks and CRC bits of each DRB in a code block segmentation stage 510 540 570 prior to channel decoding 515 545 575 to ensure that each code block has an appropriate number of bits that does not exceed a maximum code block size for channel decoding. A code block size according to the present disclosure may refer to a code block size used for channel decoding.
[0074] In some aspects, based at least in part on processing the plurality of DRBs, the communications device may apply a channel decoding scheme 515 545 575 to the signal from the code block segmentation stage 510 540 570. 3GPP 5G NR provides low-density parity check (LDPC) decoding for PDSCH and PUSCH, while turbo decoding has been used for PUSCH in 3GPP 4G LTE. For example, the communications device (e.g., BS 110, communications device 320) may apply a more robust channel decoding scheme 515 to a first subset of transport blocks including a first DRB 511, and apply a less robust channel decoding scheme 545 575 to a second subset of transport blocks including a second DRB 512 513. In one implementation, the communication device (e.g., BS 110, communication device 320) may select a base graph from a plurality of base graphs to perform LDPC channel decoding 515 on a signal including a first DRB 511, and select another base graph from the plurality of base graphs to perform LDPC channel decoding 545 575 on a signal including a second DRB 512 513.
[0075] In some aspects, based at least in part on processing the plurality of DRBs, the communications device may perform a rate matching procedure in rate matching phases 520, 550, 580. The rate matching procedure processes each channel decoded segment separately, typically in two phases: bit selection and bit reduction. Bit selection reduces the number of channel decoded bits to match the capacity of the allocated air interface resources, and bit interleaving reorders the bit sequence. In one implementation, the communications device (e.g., BS 110, communications device 320) may perform a more robust or higher rate matching 520 on a first subset of transport blocks including the first DRB 511, and perform a less robust or lower rate matching 550580 on a second subset of transport blocks including the second DRB 512513. The code block concatenation phases 52555585 perform the following operations: concatenate the code block sets into a single larger code block.
[0076] like Figure 5 As further shown in, at least in part based on processing the multiple DRBs, the communication device may perform the following operations: multiplexing the multiple DRBs, modulating the multiplexed stream, performing resource mapping, and performing orthogonal frequency division (OFDM) codeword generation to enable transmission of multiple DRBs with differential protection.
[0077] In some aspects, the communication device (e.g., BS 110, communication device 320) may perform a multiplexing function on the plurality of code blocks at a multiplexer stage 590. The multiplexing function may involve multiplexing data (e.g., video streaming data) with control information (e.g., downlink control information (DCI)). If there is no DCI to transmit, this stage may not be required.
[0078] In some aspects, the communication device (e.g., BS 110, communication device 320) may perform modulation on the multiplexed code blocks at a modulation stage 591. Modulation generally refers to the process of changing a sequence of bits ('1' or '0') into a sequence of modulation symbols, which typically includes a complex number representing a set of modulation symbols. For example, pi / 2 BPSK maps 1 bit to each modulation symbol. QPSK maps 2 bits to each modulation symbol; 16QAM maps 4 bits to each modulation symbol; 64QAM maps 5 bits to each modulation symbol; and 256QAM maps 6 bits to each modulation symbol.
[0079] The communication device may provide differential protection for different code blocks and / or transport blocks. For example, the communication device (e.g., BS 110, communication device 320) may provide differential protection or reliability for different code blocks and / or transport blocks by applying different modulation schemes to some of the code blocks and / or transport blocks (e.g., the data streams composed thereof). As a non-limiting example, the communication device (e.g., BS 110, communication device 320) may modulate a signal including a first DRB 511 using a higher modulation scheme (e.g., 16QAM) in the modulation stage 591, and modulate a signal including a second DRB 512 513 using a lower modulation scheme (e.g., 4QAM) in the modulation stage 591.
[0080] In some aspects, the communication device (e.g., BS 110, communication device 320) may perform resource mapping on a plurality of modulated symbols in a resource mapping phase 593. The resource mapping function involves mapping modulation symbols (typically precoded modulation symbols) to resource elements (REs) in allocated resource blocks (RBs) such as, for example, physical resource blocks (PRBs). These resource blocks are then used to generate an OFDM signal waveform in an OFDM signal generation phase 595. The waveform is a baseband signal that is mixed with RF before being radiated or transmitted across the air interface. For 3GPP NR, the OFDM signal generation phase 595 may involve generating a CP-OFDM signal for downlink signal transmission, and generating CP-OFDM or DFT-S-OFDM for uplink signal transmission. As indicated above, Figure 5 are provided as examples. Other examples may differ from those described in Figure 5 Examples described.
[0081] Figure 6 6 is a diagram of a system 600 illustrating a device 605 that supports video-aware communication using multiple transport blocks, in accordance with aspects of the present disclosure. Device 605 may be an example of BS 110 (illustrated as BS 110a, BS 110b, BS 110c, and BS 110d), or include components of BS 110 described herein. Device 605 may include components for two-way video data communication, including components for transmitting and receiving communications, including a communication manager 610, an I / O controller 615, a transceiver 620, an antenna 625, a memory 630, and a processor 640. These components may be in electronic communication via one or more buses (e.g., bus 645).
[0082] The video-aware processor 610 may perform video-aware communication using multiple transport blocks in accordance with various aspects of the present disclosure. In some aspects, the video-aware processor 610 may perform the following operations: classify multiple packets of streaming video content based at least in part on one or more video characteristics, wherein the one or more video characteristics are related to the impact of the packets on the quality of experience of providing the streaming video content; assign the multiple packets to multiple data radio bearers (DRBs), wherein a first DRB in the multiple DRBs includes a first subset of the multiple packets and a second DRB in the multiple DRBs includes a second subset of the multiple packets, wherein the impact of the first subset of the multiple packets on the quality of experience is higher than the impact of the second subset of the multiple packets on the quality of experience; generate multiple transport blocks, wherein a first transport block in the multiple transport blocks includes a first DRB and a second transport block in the multiple transport blocks includes a second DRB; and provide the multiple transport blocks for transmission.
[0083] I / O controller 615 can manage input and output signals for device 605. I / O controller 615 can also manage peripheral devices that are not integrated into device 605. In some cases, I / O controller 615 can represent a physical connection or port to an external peripheral device. In some cases, I / O controller 615 can utilize an operating system, such as or another known operating system. In other cases, I / O controller 615 may represent or interact with a modem, keyboard, mouse, touch screen, or similar device. In some cases, I / O controller 615 may be implemented as part of a processor. In some cases, a user may interact with device 605 via I / O controller 615 or via hardware components controlled by I / O controller 615.
[0084] The transceiver 620 can communicate bidirectionally via one or more antennas, wired or wireless links, as described above. For example, the transceiver 620 can represent a wireless transceiver and can communicate bidirectionally with another wireless transceiver. The transceiver 620 can also include a modem to modulate packets and provide the modulated packets to the antenna for transmission, and demodulate packets received from the antenna.
[0085] In some cases, a wireless device may include a single antenna 625. However, in some cases, the device may have more than one antenna 625, which may be capable of transmitting or receiving multiple wireless transmissions concurrently.
[0086] The memory 630 may include random access memory (RAM) and read-only memory (ROM). The memory 630 may store computer-readable, computer-executable code 635 including instructions that, when executed, cause the processor to perform the various functions described herein. In some cases, the memory 630 may include, among other things, a basic input / output system (BIOS), which may control basic hardware or software operations, such as interaction with peripheral components or devices.
[0087] The processor 640 may include an intelligent hardware device (e.g., a general-purpose processor, a DSP, a CPU, a microcontroller, an ASIC, an FPGA, a programmable logic device, discrete gate or transistor logic components, discrete hardware components, or any combination thereof). In some cases, the processor 640 may be configured to operate a memory array using a memory controller. In other cases, the memory controller may be integrated into the processor 640. The processor 640 may be configured to execute computer-readable instructions stored in a memory (e.g., memory 630) to cause the device 605 to perform various functions (e.g., functions or tasks that support video-aware communication using multiple transport blocks).
[0088] The code 635 may include instructions for implementing various aspects of the present disclosure, including instructions for supporting wireless communications. The code 635 may be stored in a non-transitory computer-readable medium, such as system memory or other types of memory. In some cases, the code 635 may not be directly executed by the processor 640, but may cause a computer (e.g., when compiled and executed) to perform the functions described herein.
[0089] Figure 7 is a diagram illustrating an example process 700, performed, for example, by a wireless device, in accordance with various aspects of the present disclosure. Example process 700 is an example of operations in which a communication device (e.g., BS 110 and / or device 605) performs operations associated with video-aware communication using multiple transport blocks for wireless transmission.
[0090] like Figure 7As shown in , in some aspects, process 700 may include classifying a plurality of packets of streaming video content based at least in part on one or more video characteristics. The one or more video characteristics may be related to the impact of the packets on providing a quality of experience of the streaming video content (block 710). For example, the communications device (e.g., using the video awareness processor 610, the controller / processor 240, the transmit processor 220, the TX MIMO processor 230, the MOD 232, the antenna 234, etc.) may classify a set of packets of streaming video content based at least in part on the one or more video characteristics, as described above. In some aspects, according to various aspects of the present disclosure, the one or more video characteristics may be related to the impact of the packets on providing a quality of experience of the streaming video content.
[0091] like Figure 7 As further shown in FIG, in some aspects, process 700 may include assigning the plurality of packets to a plurality of data radio bearers (DRBs). A first DRB in the plurality of DRBs may include a first subset of the plurality of packets, and a second DRB in the plurality of DRBs may include a second subset of the plurality of packets, and the first subset of the plurality of packets may have a higher impact on quality of experience than the second subset of the plurality of packets (block 720). For example, the communications device may assign the plurality of packets to a plurality of data radio bearers (DRBs). In one implementation, the communications device (e.g., using the video perception processor 610, the controller / processor 240, the transmit processor 220, the TX MIMO processor 230, the MOD 232, the antenna 234, etc.) may assign the first subset of packets to a first DRB 511 and the second subset of packets to a second DRB 512 513. Assigning the first and second subsets of packets to the first and second DRBs, respectively, may be performed based on a difference in their impact on quality of experience.
[0092] like Figure 7 As further shown in FIG. 7 , in some aspects, process 700 may include generating a plurality of transport blocks (block 730). For example, the communications device (e.g., using video awareness processor 610, controller / processor 240, transmit processor 220, TX MIMO processor 230, MOD 232, antenna 234, etc.) may generate a plurality of transport blocks, as described above. In one implementation, the communications device may generate a first transport block in the plurality of transport blocks to include a first DRB 511 and a second transport block in the plurality of transport blocks to include a second DRB 512 513. In another implementation, the communications device may generate the plurality of transport blocks based on a video frame type, such as an I-frame category 501, a P-frame category 503, or a B-frame category 502. These are merely non-limiting examples of categories that may be used.
[0093] like Figure 7 As further shown in FIG. 7 , in some aspects, process 700 may include providing the plurality of transport blocks for transmission (block 740). For example, the communications device (e.g., using video perception processor 610, controller / processor 240, transmit processor 220, TX MIMO processor 230, MOD 232, antenna 234, etc.) may provide the plurality of transport blocks, as described above with respect to FIG. Figure 5 described.
[0094] Process 700 may include additional aspects, such as any single aspect or any combination of aspects described below and / or in conjunction with one or more other processes described elsewhere herein. Figure 7 Example blocks of process 700 are shown, but in some aspects, process 700 may include Figure 7 7. In some embodiments, the process 700 may include additional blocks, fewer blocks, different blocks, or differently arranged blocks than those depicted in FIG. Additionally or alternatively, two or more blocks of process 700 may be executed in parallel.
[0095] The foregoing disclosure provides illustration and description, but is not intended to be exhaustive or to limit the aspects to the precise form disclosed. Modifications and variations may be made in light of the above disclosure or may be acquired from practice of the aspects.
[0096] As used herein, the term "component" is intended to be broadly interpreted as hardware, firmware, and / or a combination of hardware and software. As used herein, a processor is implemented using hardware, firmware, and / or a combination of hardware and software. As used herein, satisfying a threshold value may refer to a value being greater than a threshold value, greater than or equal to a threshold value, less than a threshold value, less than or equal to a threshold value, equal to a threshold value, not equal to a threshold value, etc., depending on the context.
[0097] It will be apparent that the systems and / or methods described herein can be implemented in various forms of hardware, firmware, and / or a combination of hardware and software. The actual dedicated control hardware or software code used to implement these systems and / or methods does not limit the aspects. Thus, the operation and behavior of these systems and / or methods are described herein without reference to specific software code—it is understood that software and hardware can be designed to implement these systems and / or methods based, at least in part, on the description herein.
[0098] Although specific feature combinations are described in the claims and / or disclosed in the specification, these combinations are not intended to limit the disclosure of the various aspects. In fact, many of these features can be combined in a manner not specifically described in the claims and / or not disclosed in the specification. Although each dependent claim listed below can be directly subordinate to only one claim, the disclosure of the various aspects includes that each dependent claim is combined with each other claim in this group of claims. The phrase quoting "at least one of" a list of items refers to any combination of these items, including single members. As an example, "at least one of a, b or c" is intended to cover: a, b, c, ab, ac, bc, and abc, as well as any combination with multiple identical elements (e.g., aa, aaa, aab, aac, abb, acc, bb, bbb, bbc, cc, and ccc, or any other arrangement of a, b and c).
[0099] The elements, actions or instructions used herein should not be interpreted as critical or necessary unless explicitly described as such. Moreover, as used herein, the articles "one" and "a" are intended to include one or more items and can be used interchangeably with "one or more". Furthermore, as used herein, the terms "set" and "group" are intended to include one or more items (e.g., related items, non-related items, a combination of related and non-related items, etc.) and can be used interchangeably with "one or more". Where intended to have only one item, the phrase "only one" or similar language is used. Furthermore, as used herein, the terms "having", "containing", "comprising" etc. are intended to be open terms. Furthermore, the phrase "based on" is intended to mean "based at least in part on", unless otherwise explicitly stated.
Claims
1. A wireless communication method performed by a communication device, comprising: classifying a plurality of packets of streaming video content based at least in part on one or more video characteristics, wherein the one or more video characteristics are related to an impact of the packets on providing a quality of experience of the streaming video content; assigning the plurality of packets to a plurality of data radio bearers (DRBs), wherein a first DRB of the plurality of DRBs includes a first subset of the plurality of packets and a second DRB of the plurality of DRBs includes a second subset of the plurality of packets, wherein the first subset of the plurality of packets has a higher impact on the quality of experience than the second subset of the plurality of packets; generating a plurality of transport blocks, wherein a first transport block in the plurality of transport blocks includes the first DRB and a second transport block in the plurality of transport blocks includes the second DRB; as well as Providing the plurality of transport blocks for transmission, wherein providing the plurality of transport blocks for transmission comprises: assigning a first quality of service (QoS) level to the first transport block; as well as A second QoS level is assigned to the second transport block, wherein the first QoS is higher than the second QoS.
2. The method of claim 1 , wherein providing the plurality of transport blocks for transmission comprises: applying a first redundancy to the first transport block; as well as A second redundancy is applied to the second transport block, wherein the first redundancy is higher than the second redundancy.
3. The method of claim 2, wherein the first redundancy results in a first code rate and the second redundancy results in a second code rate, the second code rate being different from the first code rate. The method of claim 3 , wherein the first code rate is lower than the second code rate.
5. The method of claim 1 , wherein assigning the first QoS level to the first transport block comprises: Applying a first modulation order to the first transport block and assigning the second QoS level to the second transport block includes applying a second modulation order to the second transport block, wherein the first modulation order is higher than the second modulation order.
6. The method of claim 1 , wherein assigning the first QoS level to the first transport block comprises: Applying a first channel decoding scheme to the first transport block and assigning the second QoS level to the second transport block includes applying a second channel decoding scheme to the second transport block, wherein the first channel decoding scheme is different from the second channel decoding scheme.
7. The method of claim 1, wherein the one or more video characteristics correspond to information related to a video frame type or discrete cosine transform (DCT) coefficients. 8 . The method of claim 7 , wherein the video frame type comprises an intra picture frame (I frame), a predicted picture frame (P frame), or a bidirectionally predicted picture frame (B frame).
9. The method of claim 7, wherein the first DRB comprises a first plurality of video frames encoded based on intra-picture frames (I frames), and the second DRB comprises a second plurality of video frames encoded based on predictive picture frames (P frames) or bidirectionally predictive picture frames (B frames).
10. An apparatus for wireless communication, comprising: one or more processors; as well as a memory coupled to the one or more processors; as well as instructions stored in the memory and executable by the one or more processors to cause the apparatus to: classifying a plurality of packets of streaming video content based at least in part on one or more video characteristics, wherein the one or more video characteristics are related to an impact of the packets on providing a quality of experience of the streaming video content; assigning the plurality of packets to a plurality of data radio bearers (DRBs), wherein a first DRB of the plurality of DRBs includes a first subset of the plurality of packets and a second DRB of the plurality of DRBs includes a second subset of the plurality of packets, wherein the first subset of the plurality of packets has a higher impact on the quality of experience than the second subset of the plurality of packets; generating a plurality of transport blocks, wherein a first transport block in the plurality of transport blocks includes the first DRB and a second transport block in the plurality of transport blocks includes the second DRB; and providing the plurality of transport blocks for transmission, wherein the memory further comprises instructions that, when executed by the one or more processors, cause the apparatus to: assigning a first quality of service (QoS) level to the first transport block; and A second QoS level is assigned to the second transport block, wherein the first QoS is higher than the second QoS.
11. The apparatus of claim 10, wherein the memory further comprises instructions that, when executed by the one or more processors, cause the apparatus to: applying a first redundancy to the first transport block; and A second redundancy is applied to the second transport block, wherein the first redundancy is higher than the second redundancy.
12. The apparatus of claim 11, wherein the first redundancy results in a first code rate and the second redundancy results in a second code rate, the second code rate being different from the first code rate. The apparatus of claim 12 , wherein the first code rate is lower than the second code rate.
14. The apparatus of claim 10, wherein the memory further comprises instructions that, when executed by the one or more processors, cause the apparatus to: applying a first modulation order to the first transport block, and A second modulation order is applied to the second transmission block, wherein the first modulation order is higher than the second modulation order.
15. The apparatus of claim 10, wherein the memory further comprises instructions that, when executed by the one or more processors, cause the apparatus to: applying a first channel decoding scheme to the first transport block, and A second channel decoding scheme is applied to the second transport block, wherein the first channel decoding scheme is different from the second channel decoding scheme.
16. The apparatus of claim 10, wherein the one or more video characteristics correspond to information related to a video frame type or discrete cosine transform (DCT) coefficients. 17 . The apparatus of claim 16 , wherein the video frame type comprises an intra picture frame (I frame), a predicted picture frame (P frame), or a bidirectionally predicted picture frame (B frame).
18. The apparatus of claim 16, wherein the first DRB comprises a first plurality of video frames encoded based on intra picture frames (I frames), and the second DRB comprises a second plurality of video frames encoded based on predictive picture frames (P frames) or bidirectionally predictive picture frames (B frames).
19. A device for wireless communication, comprising: means for classifying a plurality of packets of streaming video content based at least in part on one or more video characteristics, wherein the one or more video characteristics are related to an impact of the packets on providing a quality of experience of the streaming video content; means for assigning the plurality of packets to a plurality of data radio bearers (DRBs), wherein a first DRB of the plurality of DRBs comprises a first subset of the plurality of packets and a second DRB of the plurality of DRBs comprises a second subset of the plurality of packets, wherein the first subset of the plurality of packets has a higher impact on the quality of experience than the second subset of the plurality of packets; means for generating a plurality of transport blocks, wherein a first transport block in the plurality of transport blocks comprises the first DRB and a second transport block in the plurality of transport blocks comprises a second DRB; as well as Means for providing the plurality of transport blocks for transmission, wherein the means for providing the plurality of transport blocks for transmission comprises: means for assigning a first quality of service (QoS) level to said first transport block; as well as means for assigning a second QoS level to the second transport block, wherein the first QoS is higher than the second QoS.
20. The apparatus of claim 19, wherein the means for providing the plurality of transport blocks for transmission comprises: means for applying a first redundancy to said first transport block; as well as means for applying a second redundancy to the second transport block, wherein the first redundancy is higher than the second redundancy.
21. The apparatus of claim 20, wherein the first redundancy results in a first code rate and the second redundancy results in a second code rate, the second code rate being different from the first code rate.
22. The apparatus of claim 21, wherein the first code rate is lower than the second code rate.
23. The apparatus of claim 19, wherein the means for assigning the first QoS level to the first transport block comprises: The means for applying a first modulation order to the first transport block, and the means for assigning the second QoS level to the second transport block include: means for applying a second modulation order to the second transport block, wherein the first modulation order is higher than the second modulation order.
24. The apparatus of claim 19, wherein the means for assigning the first QoS level to the first transport block comprises: The device for applying a first channel decoding scheme to the first transport block, and the device for assigning the second QoS level to the second transport block includes: a device for applying a second channel decoding scheme to the second transport block, wherein the first channel decoding scheme is different from the second channel decoding scheme.
25. The apparatus of claim 19, wherein the one or more video characteristics correspond to information related to a video frame type or discrete cosine transform (DCT) coefficients.
26. The apparatus of claim 25, wherein the video frame type comprises an intra picture frame (I frame), a predicted picture frame (P frame), or a bidirectionally predicted picture frame (B frame).
27. The apparatus of claim 25, wherein the first DRB comprises a first plurality of video frames encoded based on intra-picture frames (I frames), and the second DRB comprises a second plurality of video frames encoded based on predictive picture frames (P frames) or bidirectionally predictive picture frames (B frames).
Citation Information
Patent Citations
Method and system for scheduling resources for streaming video services in mobile communication networks
WO2018121840A1