Improved intraplanar prediction using merge-mode motion vector candidates.
By employing advanced intra-prediction modes and adaptive signaling in video coding systems, the challenges of enhancing coding efficiency in HEVC are addressed, resulting in improved bitrate savings and perceptual quality.
Patent Information
- Application Number
- JP2024162096
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2019-01-11
- Filing Date
- 2024-09-19
- Publication Date
- 2026-01-14
- Estimated Expiration
- 2040-01-10
AI Technical Summary
Existing video coding systems, such as HEVC, face challenges in achieving further coding efficiency improvements for advanced video coding standards, particularly in handling intra-prediction modes and merge-mode motion vector candidates.
The implementation of enhanced intra-prediction modes, including planar merge mode and angular prediction, with adaptive signaling schemes to improve coding efficiency in video coding systems.
Enhances coding efficiency by optimizing intra-prediction processes, leading to improved bitrate savings and perceptual quality in video coding.
Smart Images

Figure 0007798987000012 
Figure 0007798987000013 
Figure 0007798987000014
Abstract
Description
[Technical Field]
[0001] The present invention relates to the field of communications, and more particularly to methods, apparatus, systems, architectures, and interfaces for communication in advanced or next generation wireless communication systems, including communications performed using new radio and / or new radio (NR) access technologies and communication systems. [Background technology]
[0002] Video coding (VC) systems may be used to compress digital video signals, for example, to reduce the storage needs and / or transmission bandwidth of such signals. Video coding systems may include block-based, wavelet-based, and object-based systems, and block-based hybrid video coding systems may be widely used and deployed. For example, block-based video coding systems include international video coding standards, such as MPEG (Motion Picture Experts Group) standards developed by ITU-T (International Telecommunication Union - Telecommunication Standardization Sector) / SG16 / Q.6 / VCEG (Video Coding Experts Group) and ISO / IEC / MPEG's JCT-VC (Joint Collaborative Team on Video Coding), such as MPEG1 / 2 / 4 part 2, H.264 / AVC (MPEG-4 part 10 Advanced Video Coding), VC-1, and HEVC (High Efficiency Video Coding) [4].
[0003] The HEVC system is being standardized. For example, the first edition of the HEVC standard may offer bitrate savings (e.g., approximately 50%) and / or equivalent perceptual quality compared to the previous generation video coding standard, H.264 / MPEG AVC. While the HEVC standard may offer significant coding improvements over its predecessor, superior coding efficiency may be achieved through additional coding tools within HEVC. Both VCEG and MPEG have initiated research and development of new coding technologies for future video coding standards. For example, ITU-T VCEG and ISO / IEC MPEG have formed the Joint Video Expression Team (JVET) to research advanced technologies that provide coding efficiency advances comparable to HEVC. Additionally, a software codebase called the Joint Expression Model (JEM) has been established for future video coding exploration work. The JEM reference software was based on the HEVC Test Model (HM) developed for HEVC by the JCT-VC. Any additional proposed coding tools may need to be integrated into the JEM software and tested using the JVET common test conditions (CTC).
[0004] Furthermore, like reference numbers in the drawings indicate like elements. [Brief explanation of the drawings]
[0005] [Figure 1A] FIG. 1 is a system diagram of an example communication system in which one or more disclosed aspects may be implemented. [Figure 1B] 1B is a system diagram illustrating an example WTRU (Wireless Transmit / Receive Unit) that may be used within the communication system illustrated in FIG. 1A according to one aspect. [Figure 1C] 1B is a system diagram illustrating an example RAN (Radio Access Network) and an example CN (Core Network) that may be used within the communication system illustrated in FIG. 1A according to one embodiment. [Figure 1D]FIG. 1B is a system diagram illustrating a further exemplary RAN and a further exemplary CN that may be used within the communication system illustrated in FIG. 1A according to one embodiment. [Figure 2] FIG. 1 illustrates a block-based hybrid video encoding system. [Figure 3] FIG. 1 illustrates a block-based video decoder. [Figure 4] FIG. 10 is a diagram illustrating an example of an intra-prediction mode. [Figure 5] FIG. 1 illustrates reference samples used to obtain predicted samples. [Figure 6] FIG. 1 illustrates an example of intra-planar prediction. [Figure 7] FIG. 10 is a diagram illustrating the location of adjacent spatial candidates. [Figure 8] FIG. 2 is a diagram illustrating an example of a block. [Figure 9] FIG. 1 illustrates a CU according to an embodiment. [Figure 10] 10A-10C illustrate determining bottom and right reference lines according to an embodiment. [Figure 11] FIG. 1 illustrates a CU-based scheme according to an embodiment. [Figure 12] FIG. 1 illustrates a CU having four sub-blocks according to an embodiment. [Figure 13] 10A and 10B are diagrams illustrating reference lines of sub-blocks according to an embodiment. [Figure 14] 10A and 10B are diagrams illustrating reference lines of sub-blocks according to an embodiment. [Figure 15] 10A and 10B are diagrams illustrating reference lines of sub-blocks according to an embodiment. [Figure 16] FIG. 1 illustrates a flowchart for signaling a planar merge mode flag according to an aspect. [Figure 17] FIG. 1 illustrates a flowchart for signaling for a CU-based scheme according to an embodiment. [Figure 18] FIG. 1 illustrates a flowchart for signaling an adaptive scheme according to an aspect. [Figure 19] FIG. 1 illustrates a flowchart for signaling an adaptive scheme according to an aspect. [Figure 20] FIG. 1 illustrates an example of intra angular prediction according to an embodiment. [Figure 21] FIG. 1 illustrates intra-angular prediction according to an embodiment. DETAILED DESCRIPTION OF THE INVENTION
[0006] Exemplary Network for Implementation of Aspects 1A is a diagram illustrating an example communication system 100 in which one or more disclosed aspects may be implemented. The communication system 100 may be a multiple-access system that provides content, such as voice, data, video, messaging, broadcast, etc., to multiple wireless users. The communication system 100 may enable the multiple wireless users to access such content through sharing of system resources, including wireless bandwidth. For example, the communication system 100 may employ one or more channel access methods, such as code division multiple access (CDMA), time division multiple access (TDMA), frequency division multiple access (FDMA), orthogonal frequency division multiple access (OFDMA), single-carrier FDMA (SC-FDMA), zero-tail unique-word DFT-Spread OFDM (ZT UW DTS-s OFDM), unique word OFDM (UW-OFDM), resource block-filtered OFDM, filter bank multicarrier (FBMC), etc.
[0007] 1A, communications system 100 may include wireless transmit / receive units (WTRUs) 102a, 102b, 102c, 102d, RANs 104 / 113, CNs 106 / 115, a public switched telephone network (PSTN) 108, the Internet 110, and other networks 112, although it will be understood that the disclosed aspects contemplate any number of WTRUs, base stations, networks, and / or network elements. Each of WTRUs 102a, 102b, 102c, 102d may be any type of device configured to operate and / or communicate in a wireless environment. By way of example, the WTRUs 102a, 102b, 102c, 102d may all be referred to as “stations” and / or “STAs,” may be configured to transmit and / or receive wireless signals, and may include user equipment (UE), mobile stations, fixed or mobile subscriber units, subscription-based units, pagers, cellular phones, personal digital assistants (PDAs), smartphones, laptops, netbooks, personal computers, wireless sensors, hotspots or Mi-Fi devices, Internet of Things (IoT) devices, watches or other wearables, head-mounted displays (HMDs), vehicles, drones, medical devices and applications (e.g., remote surgery), industrial devices and applications (e.g., robots and / or other wireless devices operating in the context of industrial and / or automated processing chains), consumer electronics devices, devices operating on commercial and / or industrial wireless networks, etc. Any of the WTRUs 102a, 102b, 102c, and 102d may be referred to interchangeably as a UE.
[0008] Additionally, the communications system 100 may include a base station 114a and / or a base station 114b. Each of the base stations 114a, 114b may be any type of device configured to wirelessly interface with at least one of the WTRUs 102a, 102b, 102c, 102d to facilitate access to one or more communications networks, such as the CN 106 / 115, the Internet 110, and / or other networks 112. By way of example, the base stations 114a, 114b may be a base transceiver station (BTS), a Node-B, an eNodeB, a home Node B, a home eNodeB, a gNB, a NR NodeB, a site controller, an access point (AP), a wireless router, etc. While the base stations 114a, 114b are each depicted as a single element, it will be understood that the base stations 114a, 114b may include any number of interconnected base stations and / or network elements.
[0009] The base station 114a may be part of the RAN 104 / 113, which may further include other base stations and / or network elements (not shown), such as, for example, a base station controller (BSC), a radio network controller (RNC), relay nodes, etc. The base station 114a and / or base station 114b may be configured to transmit and / or receive wireless signals on one or more carrier frequencies, which may be referred to as a cell (not shown). The frequencies may be licensed spectrum, unlicensed spectrum, or a combination of licensed and unlicensed spectrum. A cell may provide coverage for wireless services over a particular geographic area, which may be relatively fixed or may change over time. Furthermore, a cell may be divided into cell sectors. For example, the cell associated with the base station 114a may be divided into three sectors. Thus, in one aspect, the base station 114a may include three transceivers, i.e., one for each sector of the cell. In an aspect, the base station 114a may employ multiple-input multiple output (MIMO) technology and may utilize multiple transceivers for each sector of the cell. For example, beamforming may be used to transmit and / or receive signals in a desired spatial direction.
[0010] The base stations 114a, 114b may communicate with one or more of the WTRUs 102a, 102b, 102c, 102d over an air interface 116, which may be any suitable wireless communication link (e.g., radio frequency (RF), microwave, centimeter wave, micrometer wave, infrared (IR), ultraviolet (UV), visible light, etc.). The air interface 116 may be established using any suitable radio access technology (RAT).
[0011] More specifically, as mentioned above, the communication system 100 may be a multiple-access system and may employ one or more channel access schemes, such as, for example, CDMA, TDMA, FDMA, OFDMA, SC-FDMA, etc. For example, the base station 114a in the RAN 104 / 113 and the WTRUs 102a, 102b, 102c may implement a radio technology such as Universal Mobile Telecommunications System (UMTS) Terrestrial Radio Access (UTRA), which may establish the air interface 115 / 116 / 117 using, for example, wideband CDMA (WCDMA). WCDMA may include communication protocols such as High-Speed Packet Access (HSPA) and / or Evolved HSPA+ (HSPA+). HSPA may include High-Speed Downlink Packet Access (HSDPA) and / or High-Speed Ultra-Low Packet Access (HSUPA).
[0012] In an aspect, the base station 114a and the WTRUs 102a, 102b, 102c may establish the air interface 116 using Long Term Evolution (LTE) and / or LTE-Advanced (LTE-A) and / or LTE-Advanced Pro (LTE-A Pro), and may implement a radio technology such as Evolved UMTS Terrestrial Radio Access (E-UTRA).
[0013] In an aspect, the base station 114a and the WTRUs 102a, 102b, 102c may establish the air interface 116 using New Radio (NR) and may implement a radio technology such as NR radio access. In an aspect, the base station 114a and the WTRUs 102a, 102b, 102c may implement multiple radio access technologies. For example, the base station 114a and the WTRUs 102a, 102b, 102c may implement both LTE radio access and NR radio access, e.g., using dual connectivity (DC) principles. Thus, the air interface utilized by the WTRUs 102a, 102b, 102c may be characterized by multiple types of radio access technologies and / or transmissions sent to / from multiple types of base stations (e.g., eNBs and gNBs).
[0014] In other aspects, the base station 114a and the WTRUs 102a, 102b, 102c may implement a wireless technology such as, for example, IEEE 802.11 (i.e., Wireless Fidelity (WiFi)), IEEE 802.16 (i.e., Worldwide Interoperability for Microwave Access (WiMAX)), CDMA2000, CDMA2000 1X, CDMA2000EV-DO, Interim Standard 2000 (IS-2000), Interim Standard 95 (IS-95), Interim Standard 856 (IS-856), Global System for Mobile communications (GSM), Enhanced Data rates for GSM Evolution (EDGE), GERAN (GSM EDGE), etc.
[0015] 1A may be, for example, a wireless router, a Home Node B, a Home eNode B, or an access point and may utilize any suitable RAT to facilitate wireless connectivity in a local area such as, for example, a business, a home, a vehicle, a campus, an industrial facility, an air corridor (e.g., for use by drones), a roadway, etc. In one aspect, the base station 114b and the WTRUs 102c, 102d may implement a radio technology such as, for example, IEEE 802.11 to establish a wireless local area network (WLAN). In an aspect, the base station 114b and the WTRUs 102c, 102d may implement a radio technology such as, for example, IEEE 802.15 to establish a wireless personal area network (WPAN). In yet another aspect, the base station 114b and the WTRUs 102c, 102d may utilize a cellular-based RAT (e.g., WCDMA, CDMA2000, GSM, LTE, LTE-A, LTE-A Pro, NR, etc.) to establish a picocell or a femtocell. As shown in FIG. 1A, the base station 114b may have a direct connection to the Internet 110. Thus, the base station 114b may not be required to access the Internet 110 via the CN 106 / 115.
[0016] The RAN 104 / 113 may be in communication with the CN 106 / 115 and may be any type of network configured to provide voice, data, application, and / or voice over internet protocol (VoIP) services to one or more of the WTRUs 102a, 102b, 102c, 102d. The data may have various quality of service (QoS) requirements, such as, for example, different throughput requirements, latency requirements, error tolerance requirements, reliability requirements, data throughput requirements, mobility requirements, etc. The CN 106 / 115 may provide call control, billing services, mobile location-based services, prepaid calling, Internet connectivity, video distribution, etc., and / or perform high-level security functions, such as, for example, user authentication. 1A, it will be understood that the RAN 104 / 113 and / or the CN 106 / 115 may be in direct or indirect communication with other RANs employing the same RAT as the RAN 104 / 113 or a different RAT. For example, the CN 106 / 115, in addition to being connected to the RAN 104 / 113, which may utilize NR radio technology, may also be in communication with another RAN (not shown) employing GSM, UMTS, CDMA2000, WiMAX, E-UTRA, or WiFi radio technology.
[0017] Additionally, the CN 106 / 115 may serve as a gateway for the WTRUs 102a, 102b, 102c, 102d to access the PSTN 108, the Internet 110, and / or other networks 112. The PSTN 108 may include a circuit-switched telephone network providing plain old telephone service (POTS). The Internet 110 may include a global system of interconnected computer networks and devices that use common communication protocols, such as transmission control protocol (TCP), user datagram protocol (UDP), and / or IP in the TCP / IP Internet Protocol suite. The network 112 may include wired and / or wireless communication networks owned and / or operated by other service providers. For example, the network 112 may include another CN connected to one or more RANs, which may employ the same RAT as the RAN 104 / 113 or a different RAT.
[0018] Some or all of the WTRUs 102a, 102b, 102c, 102d in the communications system 100 may include multi-mode capabilities (e.g., the WTRUs 102a, 102b, 102c, 102d may include multiple transceivers for communicating with separate wireless networks over separate wireless links). For example, the WTRU 102c shown in FIG. 1A may be configured to communicate with a base station 114a, which may employ a cellular-based radio technology, and with a base station 114b, which may employ an IEEE 802.11 radio technology.
[0019] 1B is a system diagram illustrating an example WTRU 102. As shown in FIG. 1B, the WTRU 102 may include, among other things, a processor 118, a transceiver 120, a transmit / receive element 122, a speaker / microphone 124, a keypad 126, a display / touchpad 128, non-removable memory 130, removable memory 132, a power source 134, a GPS (Global Positioning System) chipset 136, and / or other peripherals 138. It will be understood that the WTRU 102 may include any sub-combination of the above elements without departing from the spirit and scope of the present invention.
[0020] The processor 118 may be a general-purpose processor, a special-purpose processor, a conventional processor, a digital signal processor (DSP), multiple microprocessors, one or more microprocessors in conjunction with a DSP core, a controller, a microcontroller, an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA) circuit, any of other types of integrated circuits (ICs), a state machine, etc. The processor 118 may perform signal coding, data processing, power control, input / output processing, and / or any other functionality that enables the WTRU 102 to operate in a wireless environment. The processor 118 may be coupled to a transceiver 120, which may be coupled to a transmit / receive element 122. While FIG. 1B depicts the processor 118 and the transceiver 120 as separate components, it will be understood that the processor 118 and the transceiver 120 may be integrated together in an electronic package or chip.
[0021] The transmit / receive element 122 may be configured to transmit or receive signals to a base station (e.g., base station 114a) over the air interface 116. For example, in one aspect, the transmit / receive element 122 may be an antenna configured to transmit and / or receive RF signals. In an aspect, the transmit / receive element 122 may be an emitter / detector configured to transmit and / or receive, for example, IR, UV, or visible light signals. In yet another aspect, the transmit / receive element 122 may be configured to transmit and / or receive both RF and light signals. It will be understood that the transmit / receive element 122 may be configured to transmit and / or receive any combination of wireless signals. 1B as a single element, the WTRU 102 may include any number of transmit / receive elements 122. More specifically, the WTRU 102 may employ MIMO techniques. Thus, in one aspect, the WTRU 102 may include two or more transmit / receive elements 122 (e.g., multiple antennas) for transmitting and receiving wireless signals over the air interface 116.
[0022] The transceiver 120 may be configured to modulate signals to be transmitted by the transmit / receive element 122 and to demodulate signals received by the transmit / receive element 122. As mentioned above, the WTRU 102 may have multi-mode capabilities. Thus, for example, the transceiver 120 may include multiple transceivers to enable the WTRU 102 to communicate over multiple RATs, such as NR and IEEE 802.11.
[0023] The processor 118 of the WTRU 102 may be coupled to and may receive user input data through a speaker / microphone 124, a keypad 126, and / or a display / touchpad 128 (e.g., a liquid crystal display (LCD) display unit or an organic light-emitting diode (OLED) display unit). Further, the processor 118 may output user data to the speaker / microphone 124, the keypad 126, and / or the display / touchpad 128. Additionally, the processor 118 may access information and store data in any suitable type of memory, such as non-removable memory 130 and / or removable memory 132. The non-removable memory 130 may include random-access memory (RAM), read-only memory (ROM), a hard disk, or any other type of memory storage device. The removable memory 132 may include a subscriber identity module (SIM) card, a memory stick, a secure digital (SD) memory card, etc. In other aspects, the processor 118 may access information and store data in memory that is not physically located in the WTRU 102, such as in a server or host computer (not shown).
[0024] The processor 118 may receive power from the power source 134 and may be configured to distribute and / or control power to other components in the WTRU 102. The power source 134 may be any device suitable for providing power to the WTRU 102. For example, the power source 134 may include one or more dry batteries (e.g., NiCd (nickel cadmium), NiZn (nickel zinc), NiMH (nickel metal hydride), Li-ion (lithium ion), etc.), solar cells, fuel cells, etc.
[0025] Additionally, the processor 118 may be coupled to a GPS chipset 136 that may be configured to provide location information (e.g., longitude and latitude) regarding the current location of the WTRU 102. In addition to or instead of information from the GPS chipset 136, the WTRU 102 may receive location information from a base station (e.g., base stations 114a, 114b) over the air interface 116 and / or determine its location based on the timing of signals being received from two or more neighboring base stations. It will be understood that the WTRU 102 may obtain location information through any suitable location-determination method without departing from the spirit or scope of the present invention.
[0026] Additionally, the processor 118 may be coupled to other peripherals 138, which may include one or more software and / or hardware modules that provide additional features, functionality, and / or wired or wireless connectivity. For example, the peripherals 138 may include an accelerometer, an e-compass, a satellite transceiver, a digital camera (for photos and / or videos), a Universal Serial Bus (USB) port, a vibration device, a television transceiver, a hands-free headset, a Bluetooth® module, a frequency modulated (FM) radio unit, a digital music player, a media player, a video game player module, an internet browser, a virtual reality and / or augmented reality (VR / AR) device, an activity tracker, etc. The peripheral device 138 may include one or more sensors, which may be one or more of a gyroscope, an accelerometer, a Hall effect sensor, a magnetometer, a direction sensor, a proximity sensor, a temperature sensor, a time sensor, a geolocation sensor, an altimeter, a light sensor, a touch sensor, a magnetometer, a barometer, a gesture sensor, a biometric sensor, and / or a humidity sensor.
[0027] The WTRU 102 may include a full-duplex radio where the transmission and reception of some or all of the signals (e.g., associated with a particular subframe for both the UL (e.g., for transmission) and downlink (e.g., for reception)) may be parallel and / or simultaneous. The full-duplex radio may include an interference management unit to reduce and or substantially eliminate self-interference, either by hardware (e.g., a choke) or signal processing by a processor (e.g., a separate processor (not shown) or by the processor 118). In an aspect, the WTRU 102 may include a half-duplex radio where the transmission and reception of some or all of the signals (e.g., associated with a particular subframe for either the UL (e.g., for transmission) or downlink (e.g., for reception)) may be half-duplex.
[0028] 1C is a system diagram illustrating the RAN 104 and the CN 106, according to an embodiment. As mentioned above, the RAN 104 may employ E-UTRA radio technology to communicate with the WTRUs 102a, 102b, 102c over the air interface 116. Additionally, the RAN 104 may be in communication with the CN 106.
[0029] The RAN 104 may include eNode-Bs 160a, 160b, and 160c, although it will be understood that the RAN 104 may include any number of eNode-Bs while remaining consistent with an aspect. The eNode-Bs 160a, 160b, and 160c may each include one or more transceivers for communicating with the WTRUs 102a, 102b, and 102c over the air interface 116. In one aspect, the eNode-Bs 160a, 160b, and 160c may implement MIMO technology. Thus, for example, the eNode-B 160a may use multiple antennas to transmit and / or receive wireless signals to the WTRU 102a.
[0030] Each of the eNode-Bs 160a, 160b, 160c may be associated with a particular cell (not shown) and may be configured to handle radio resource management decisions, handover decisions, scheduling of users in the UL and / or DL, etc. As shown in FIG. 1C, the eNode-Bs 160a, 160b, 160c may communicate with each other via an X2 interface.
[0031] 1C may include a mobility management entity (MME) 162, a serving gateway (SGW) 164, and a packet data network (PDN) gateway (or PGW) 166. While each of the above elements is depicted as part of the CN 106, it will be understood that any of the just-mentioned elements may be owned and / or operated by an entity other than the CN operator.
[0032] The MME 162 may be connected to each of the eNode-Bs 160a, 160b, 160c in the RAN 104 via an S1 interface and may act as a control node. For example, the MME 162 may be responsible for authenticating users of the WTRUs 102a, 102b, 102c, activating / deactivating bearers, selecting a particular serving gateway during initial attachment of the WTRUs 102a, 102b, 102c, etc. The MME 162 may provide a control plane function for switching between the RAN 104 and other RANs (not shown) that employ other radio technologies, such as GSM and / or WCDMA.
[0033] The SGW 164 may be connected to each of the eNode Bs 160a, 160b, 160c in the RAN 104 via an S1 interface. In general, the SGW 164 may route and forward user data packets to the WTRUs 102a, 102b, 102c. The SGW 164 may perform other functions such as, for example, anchoring the user plane during inter-eNode B handovers, triggering paging when DL data is available to the WTRUs 102a, 102b, 102c, managing and storing the context of the WTRUs 102a, 102b, 102c, etc.
[0034] The SGW 164 may be connected to a PGW 166, which may provide the WTRUs 102a, 102b, 102c with access to a packet-switched network, such as the Internet 110, to facilitate communication between the WTRUs 102a, 102b, 102c and IP-enabled devices.
[0035] The CN 106 may facilitate communication with other networks. For example, the CN 106 may provide the WTRUs 102a, 102b, 102c with access to circuit-switched networks, such as the PSTN 108, to facilitate communication between the WTRUs 102a, 102b, 102c and traditional landline communication devices. For example, the CN 106 may include or communicate with an IP gateway (e.g., an IMS (IP Multimedia Subsystem) server) that serves as an interface between the CN 106 and the PSTN 108. In addition, the CN 106 may provide the WTRUs 102a, 102b, 102c with access to other networks 112, which may include other wired and / or wireless networks owned and / or operated by other service providers.
[0036] Although the WTRU is described in Figures 1A-1D as a wireless terminal, it is expected that in certain exemplary aspects, such a terminal may use a wired communication interface with the communication network (e.g., temporarily or permanently). In an exemplary aspect, the other network 112 may be a WLAN.
[0037] A WLAN in infrastructure Basic Service Set (BSS) mode may have an access point (AP) for the BSS and one or more stations (STAs) associated with the AP. The AP may have access or an interface to a distribution system (DS) or another type of wired / wireless network that carries traffic into and out of the BSS. Traffic to a STA originating from outside the BSS may arrive through the AP and be delivered to the STA. Traffic originating from a STA to a destination outside the BSS may be sent to the AP and delivered to the respective destination. Traffic between STAs within a BSS may be sent through the AP, for example, where a source STA may send traffic to the AP, and the AP may deliver the traffic to the destination STA. Traffic between STAs within a BSS may be considered and / or referred to as peer-to-peer traffic. Peer-to-peer traffic may be sent between (e.g., directly between) a source and destination STA via a direct link setup (DLS). In one exemplary aspect, the DLS may use 802.11e DLS or 802.11z TDLS (tunneled DLS). A WLAN using an Independent BSS (IBSS) mode may not have an AP, and STAs within or using the IBSS (e.g., all STAs) may communicate directly with each other. The IBSS mode of communication may sometimes be referred to herein as an "ad hoc" mode of communication.
[0038] When using the 802.11ac infrastructure mode of operation or a similar mode of operation, an AP may transmit beacons on a fixed channel, such as a primary channel. The primary channel may be a fixed width (e.g., a 20 MHz wide bandwidth) or a width that is dynamically set by signaling. The primary channel may be the operating channel of the BSS and may be used by STAs to establish a connection with the AP. In a typical aspect, CSMA / CA (Carrier Sense Multiple Access / Collision Avoidance) may be implemented in an 802.11 system, for example. With CSMA / CA, STAs (e.g., all STAs), including the AP, may sense the primary channel. If the primary channel is sensed / detected and / or determined to be busy by a particular STA, the particular STA may back off. One STA (e.g., only one station) may transmit in a given BSS at any given time.
[0039] For example, a HT (high throughput) STA may use a 40 MHz wide channel for communication by combining a 20 MHz primary channel with adjacent or non-adjacent 20 MHz channels to form a 40 MHz wide channel.
[0040] A Very High Throughput (VHT) STA may support channels of 20 MHz, 40 MHz, 80 MHz, and / or 160 MHz width. 40 MHz and / or 80 MHz channels may be constructed by combining contiguous 20 MHz channels. A 160 MHz channel may be constructed by combining eight contiguous 20 MHz channels or by combining two non-contiguous 80 MHz channels, which may result in an 80+80 configuration. For the 80+80 configuration, after channel encoding, the data may pass through a segment parser, which may split the data into two streams. IFFT (inverse fast Fourier transform) processing and time-domain processing may be performed on each stream separately. The streams may be mapped onto two 80 MHz channels, and the data may be transmitted by the transmitting STA. At the receiver of the receiving STA, the operations for the 80+80 configuration described above may be reversed and the combined data may be sent to the MAC (Media Access Control).
[0041] Sub-1 GHz modes of operation are supported by 802.11af and 802.11ah. The operating bandwidths of the channels and carriers are reduced in 802.11af and 802.11ah compared to those used in 802.11n and 802.11ac. 802.11af supports 5 MHz, 10 MHz, and 20 MHz bandwidths in TVWS (TV White Space) spectrum, while 802.11ah supports 1 MHz, 2 MHz, 4 MHz, 8 MHz, and 16 MHz bandwidths using non-TVWS spectrum. According to an exemplary aspect, 802.11ah may support Meter Type Control / Machine-Type Communication, such as for MTC devices in macro coverage areas. MTC devices may have limited capabilities, including support (e.g., only support) for some and / or limited bandwidths. An MTC device may include a battery with a battery life that exceeds a threshold (eg, to maintain a very long battery life).
[0042] A WLAN system that may support multiple channels and channel bandwidths, such as 802.11n, 802.11ac, 802.11af, and 802.11ah, includes a channel that may be designated as a primary channel. The primary channel may have a bandwidth equal to the largest common operating bandwidth supported by all STAs in the BSS. The bandwidth of the primary channel may be set and / or limited by the STA that supports the smallest bandwidth operating mode among all STAs operating in the BSS. In the 802.11ah example, the primary channel may be 1 MHz wide for a STA (e.g., an MTC-type device) that supports (e.g., only supports) the 1 MHz mode, even if the AP and other STAs in the BSS support 2 MHz, 4 MHz, 8 MHz, 16 MHz, and / or other channel bandwidth operating modes. Carrier sensing and / or NAV (Network Allocation Vector) setting may depend on the state of the primary channel. If the primary channel is busy, for example, due to a STA (that only supports a 1 MHz mode of operation) transmitting to the AP, the entire available frequency band may be considered busy even though most of the frequency band may remain idle and available.
[0043] In the United States, the available frequency bands that may be used by 802.11ah are 902 MHz to 928 MHz. In South Korea, the available frequency bands are 917.5 MHz to 923.5 MHz. In Japan, the available frequency bands are 916.5 MHz to 927.5 MHz. The total bandwidth available for 802.11ah is 6 MHz to 26 MHz, depending on the country code.
[0044] 1D is a system diagram illustrating the RAN 113 and the CN 115 according to an aspect. As mentioned above, the RAN 113 may employ NR radio technology to communicate with the WTRUs 102a, 102b, 102c over the air interface 116. Additionally, the RAN 113 may be in communication with the CN 115.
[0045] The RAN 113 may include gNBs 180a, 180b, and 180c, although it will be understood that the RAN 113 may include any number of gNBs without being inconsistent with an aspect. The gNBs 180a, 180b, and 180c may each include one or more transceivers for communicating with the WTRUs 102a, 102b, and 102c over the air interface 116. In one aspect, the gNBs 180a, 180b, and 180c may implement MIMO techniques. For example, the gNBs 180a, 180b may utilize beamforming to transmit and / or receive signals to the gNBs 180a, 180b, and 180c. Thus, for example, the gNB 180a may use multiple antennas to transmit and / or receive wireless signals to the WTRU 102a. In an aspect, the gNBs 180a, 180b, and 180c may implement carrier aggregation techniques. For example, the gNB 180a may transmit multiple component carriers to the WTRU 102a (not shown). A subset of the aforementioned component carriers may be on a non-licensed spectrum, while the remaining component carriers may be on a licensed spectrum. In an aspect, the gNBs 180a, 180b, and 180c may implement Coordinated Multi-Point (CoMP) techniques. For example, the WTRU 102a may receive coordinated transmissions from the gNBs 180a and 180b (and / or 180c).
[0046] The WTRUs 102a, 102b, 102c may communicate with the gNBs 180a, 180b, 180c using transmissions associated with scalable numerology. For example, the OFDM symbol spacing and / or OFDM subcarrier spacing may vary for separate transmissions, separate cells, and / or separate portions of the wireless transmission spectrum. The WTRUs 102a, 102b, 102c may communicate with the gNBs 180a, 180b, 180c using subframes or transmission time intervals (TTIs) of various or scalable lengths (e.g., including various numbers of OFDM symbols and / or various absolute time lengths).
[0047] The gNBs 180a, 180b, 180c may be configured to communicate with the WTRUs 102a, 102b, 102c in a standalone configuration and / or a non-standalone configuration. In a standalone configuration, the WTRUs 102a, 102b, 102c may communicate with the gNBs 180a, 180b, 180c without accessing another RAN (e.g., eNode-Bs 160a, 160b, 160c, etc.). In a standalone configuration, the WTRUs 102a, 102b, 102c may utilize one or more of the gNBs 180a, 180b, 180c as mobility anchor points. In a standalone configuration, the WTRUs 102a, 102b, 102c may communicate with the gNBs 180a, 180b, 180c using signals in unlicensed bands. In a non-standalone configuration, the WTRUs 102a, 102b, 102c may communicate / connect with a gNB 180a, 180b, 180c while also communicating / connecting with another RAN, such as, for example, an eNode-B 160a, 160b, 160c. For example, the WTRUs 102a, 102b, 102c may implement DC principles to communicate with one or more gNBs 180a, 180b, 180c and one or more eNode-Bs 160a, 160b, 160c substantially simultaneously. In a non-standalone configuration, the eNode-Bs 160a, 160b, 160c may act as mobility anchors for the WTRUs 102a, 102b, 102c, and the gNBs 180a, 180b, 180c may provide additional coverage and / or throughput in serving the WTRUs 102a, 102b, 102c.
[0048] Each of the gNBs 180a, 180b, 180c may be associated with a particular cell (not shown) and may be configured to handle radio resource management decisions, handover decisions, scheduling of users in the UL and / or DL, support for network slicing, dual connectivity, interworking between NR and E-UTRA, routing of user plane data to User Plane Functions (UPFs) 184a, 184b, routing of control plane information to Access and Mobility Management Functions (AMFs) 182a, 182b, etc. As shown in FIG. 1D , the gNBs 180a, 180b, 180c may communicate with each other via an Xn interface.
[0049] 1D may include at least one AMF 182a, 182b, at least one UPF 184a, 184b, at least one SMF (Session Management Function) 183a, 183b, and possibly a DN (Data Network) 185a, 185b. While each of the above elements is depicted as part of the CN 115, it will be understood that any of the just-mentioned elements may be owned and / or operated by an entity other than the CN operator. The AMF 182a, 182b may be connected to one or more of the NBs 180a, 180b, 180c in the RAN 113 via an N2 interface and may act as a control node. For example, the AMF 182a, 182b may be responsible for authenticating users of the WTRUs 102a, 102b, 102c, supporting network slicing (e.g., handling sessions of separate PDUs with separate requirements), selecting a particular SMF 183a, 183b, managing registration areas, terminating NAS signaling, mobility management, etc. Network slicing may be used by the AMF 182a, 182b to customize CN support for the WTRUs 102a, 102b, 102c based on the type of service being used for the WTRUs 102a, 102b, 102c. For example, separate network slices may be established for separate use cases, such as services relying on Ultra-Reliable Low-Latency (URLLC) access, services relying on enhanced massive mobile broadband (eMBB) access, services related to machine-type communications (MTC) access, etc. The AMF 162 may provide control plane functionality for switching between the RAN 113 and other RANs (not shown) employing other radio technologies, such as LTE, LTE-A, LTE-A Pro, and / or non-3GPP access technologies, such as WiFi.
[0050] The SMFs 183a and 183b may be connected to the AMFs 182a and 182b in the CN 115 via an N11 interface. Furthermore, the SMFs 183a and 183b may be connected to the UPFs 184a and 184b in the CN 115 via an N4 interface. The SMFs 183a and 183b may select and control the UPFs 184a and 184b and configure the routing of traffic through the UPFs 184a and 184b. The SMFs 183a and 183b may perform other functions, such as managing and assigning UE IP addresses, managing PDU sessions, controlling policy enforcement and QoS, providing downlink data notification, etc. The PDU session type may be IP-based, non-IP-based, Ethernet-based, etc.
[0051] The UPFs 184a, 184b may be connected to one or more of the gNBs 180a, 180b, 180c in the RAN 113 via an N3 interface and may provide the WTRUs 102a, 102b, 102c with access to a packet-switched network such as the Internet 110 to facilitate communications between the WTRUs 102a, 102b, 102c and IP-enabled devices. The UPFs 184, 184b may perform other functions such as, for example, routing and forwarding packets, enforcing user plane policies, supporting multi-homed PDU sessions, handling user plane QoS, buffering downlink packets, providing mobility anchoring, etc.
[0052] The CN 115 may facilitate communication with other networks. For example, the CN 115 may include or communicate with an IP gateway (e.g., an IMS (IP Multimedia Subsystem) server) that acts as an interface between the CN 115 and the PSTN 108. In addition, the CN 115 may provide the WTRUs 102a, 102b, 102c with access to other networks 112, which may include other wired and / or wireless networks owned and / or operated by other service providers. In one aspect, the WTRUs 102a, 102b, 102c may be connected to local DNs (Data Networks) 185a, 185b through an N3 interface to the UPFs 184a, 184b, and an N6 interface between the UPFs 184a, 184b and the DNs 185a, 185b.
[0053] 1A-1D and the corresponding description thereof, one or more or all of the functions described herein in association with one or more of the WTRUs 102a-d, base stations 114a-b, eNode-Bs 160a-c, MME 162, SGW 164, PGW 166, gNBs 180a-c, AMFs 182a-b, UPFs 184a-b, SMFs 183a-b, DNs 185a-b, and / or any other device(s) described herein may be performed by one or more emulation devices (not shown). The emulation devices may be one or more devices configured to emulate one or more or all of the functions described herein. For example, the emulation devices may be used to test other devices and / or to simulate network and / or WTRU functionality.
[0054] The emulation device may be designed to implement one or more tests of other devices in a lab environment and / or in an operator's network environment. For example, one or more emulation devices may perform one or more, or all, functions while fully or partially implemented and / or deployed as part of a wired and / or wireless communications network to test other devices in the communications network. One or more emulation devices may perform one or more, or all, functions while temporarily implemented / deployed as part of a wired and / or wireless communications network. The emulation device may be directly coupled to another device for testing purposes and / or may perform testing using over-the-air (OTA) wireless communications.
[0055] The one or more emulation devices may perform one or more functions, inclusive, while not being implemented / deployed as part of a wired and / or wireless communications network. For example, the emulation devices may be utilized in testing laboratories and / or testing scenarios in undeployed (e.g., testing) wired and / or wireless communications networks to implement testing of one or more components. The one or more emulation devices may be test equipment. Direct RF coupling and / or wireless communication via RF circuitry (which may, for example, include one or more antennas) may be used by the emulation devices to transmit and / or receive data.
[0056] Detailed Description VVC (Versatile Video Coding) Versatile Video Coding (VVC) is a (e.g., new, next-generation) video coding standard. For example, VVC may refer to a video coding standard that has capabilities beyond HEVC. Research is being conducted for standard dynamic range video content categories regarding new video coding standards that may achieve approximately 40% compression efficiency gains over HEVC (e.g., 10th Generation). 回 (See JVET meeting). Based on the above evaluation results, the Joint Video Expert Team (JVET) began developing the VVC video coding standard. Furthermore, a reference software code base called the VVC Test Model (VTM) was established to demonstrate a reference implementation of the VVC standard. Regarding the initial VTM-1.0, most coding modules, including intra-prediction, inter-prediction, transform / inverse transform and quantization / inverse quantization, and in-loop filters, may follow (e.g., be the same, similar, or correspond to) the existing HEVC design. However, VVC differs from HEVC in that one multi-type tree-based block partitioning structure may be used in VTM.
[0057] FIG. 2 is a diagram illustrating a block-based hybrid video encoding system.
[0058] Referring to Figure 2, a block-based hybrid video encoding system 200 may be a comprehensive block-based hybrid video coding framework. VVC, similar to HEVC, may use (e.g., may have or may be based on) a block-based hybrid video coding framework. Referring to Figure 2, an input video signal 202 may be processed according to coding units (CUs). In other words, the input video signal may be processed block by block, and each block may be referred to as a CU.
[0059] In the case of VTM-1.0, a CU can be up to 128x128 pixels. Furthermore, in the case of VTM-1.0, a coding tree unit (CTU) may be divided into CUs based on a quadtree / binarytree / ternarytree, for example, to adapt to changing local characteristics. Compared to VTM-1.0, in the case of HEVC, blocks are divided only based on a quadtree. Furthermore, in the case of HEVC, the concept of multiple partition unit types, including, for example, CUs, prediction units (PUs), and transform units (TUs), is included. In the case of VTM-1.0, the concept of multiple partition unit types (e.g., as used in HEVC) may not be used (e.g., may be removed). That is, in the case of VTM-1.0, there may be no separation of CUs, prediction units (PUs), and transform units (TUs). In the case of VTM-1.0, each CU may be used (e.g., always) as a basic unit for either prediction and transform (e.g., for both PUs and TUs) without further division. In the case of a multi-type tree structure, (e.g., one) CTU may be (e.g., initially) divided by a quad-tree structure, and then each quad-tree leaf node may be (e.g., further) divided by either a binary tree structure or a ternary tree structure.
[0060] Referring to FIG. 2, spatial prediction 260 and / or temporal prediction 262 may be performed. Spatial prediction (e.g., also referred to as intra-prediction) may predict a current video block using pixels of samples (e.g., also referred to as reference samples) of neighboring blocks already coded in the same video picture / slice. Spatial prediction may reduce spatial redundancy that may be inherent in a video signal. Temporal prediction (e.g., also referred to as inter-prediction or motion-compensated prediction) may predict a current video block using pixels reconstructed from an already coded video picture. Temporal prediction may reduce temporal redundancy that may be inherent in a video signal. The temporal prediction signal for a given CU may be (e.g., is typically) signaled by one or more motion vectors (MVs). The MVs may indicate either the amount and direction of motion between the current CU and the temporal reference. If multiple reference pictures are supported, a reference picture index (e.g., one) may additionally be sent to identify the reference picture in, for example, reference picture store 264 from which the temporal prediction signal comes.
[0061] Referring to FIG. 2, a mode decision 280 (e.g., located / performed in an encoder) may choose (e.g., select, determine, etc.) the best prediction mode. For example, after spatial prediction and / or temporal prediction, the mode selection may be used to determine the best prediction mode according to a rate-distortion optimization method. The prediction block may (e.g., then) be subtracted from the current video block 216, and the prediction residual may be decorrelated using a transform 204 and quantized 206 to generate quantized residual coefficients. The quantized residual coefficients may be inverse quantized 210 and inverse transformed 212 to form a reconstructed residual, which may (e.g., then) be added back to the prediction block 226 to form, for example, a reconstructed signal of a CU.
[0062] In-loop filtering 266 (e.g., further in-loop filtering, such as a deblocking filter) may be applied to the reconstructed CUs, for example, before being placed in the reference picture store 264, and the in-loop filtered reconstructed samples may be used to encode future video blocks. The output video bitstream 220 may be formed by sending any of the coding mode (e.g., inter or intra), prediction mode information, motion information, and quantized residual coefficients to the entropy coding unit 208. The entropy coding unit 208 may (e.g., further) compress and pack any of the coding mode (e.g., inter or intra), prediction mode information, motion information, and quantized residual coefficients to form the bitstream.
[0063] FIG. 3 is a diagram illustrating a block-based video decoder.
[0064] 3, a (e.g., general) block-based video decoder 300 may receive (e.g., read, input, etc.) a video bitstream 302. The video bitstream 302 may be (e.g., initially) unpacked and entropy decoded in an entropy decoding unit 308. Coding mode and prediction information may be provided (e.g., sent) to, for example, either a spatial prediction unit 360 (e.g., in the case of intra-coding) or a temporal prediction unit 362 (e.g., in the case of inter-coding) to form a prediction block.
[0065] The residual transform coefficients may be provided (e.g., sent) to, for example, either the inverse quantization unit 310 or the inverse transform unit 312 to reconstruct a residual block. The predictive block and the residual block may (e.g., then) be added together at a block (e.g., adder) 326. The reconstructed block may (e.g., further) go through in-loop filtering before being stored in a reference picture store 364. The reconstructed video (e.g., stored in the reference picture store 364) may be provided (e.g., sent, used, etc.) to drive a display device or may be used to predict future video blocks.
[0066] In subsequent versions of VTM, new coding tools are increasingly integrated. For example, a coding mode for predicting chrominance from luminance is included in VTM. Additionally, techniques for predicting chrominance from luminance are also under investigation and are described further below.
[0067] Intra prediction FIG. 4 is a diagram illustrating intra prediction modes.
[0068] Intra prediction in VTM may include multiple angular modes (e.g., 65 modes) and may further include either a non-angular planar mode or a non-angular DC mode. Both the non-angular planar mode and the non-angular DC mode may be the same as those in HEVC. Referring to Figure 4, of the 65 angular modes, 33 are the same as those in HEVC, and 32 are different from those in HEVC (e.g., as depicted by the solid black lines with arrows). Angular modes, sometimes referred to as directional modes, may be applied to all block sizes for both luma and chroma intra prediction. In the case of non-square blocks, some conventional angular modes may be adaptively replaced with wide-angle intra prediction modes. When using DC mode for non-square blocks, only the longer side may be used for calculating the average.
[0069] Intra-planar prediction FIG. 5 is a diagram illustrating reference samples used to obtain predicted samples.
[0070] A planar mode may provide order-1 prediction. A planar mode may be (e.g., inherently) for order-1 prediction, and may predict a block by using, for example, a bilinear model derived from above and left reference samples (e.g., reference samples located above and to the left adjacent to a CU), as shown in FIG. 5. Planar mode operation may include calculating two linear predictions and averaging them, as shown in the following Equations 1 to 3:
[0071]
number
[0072]
number
[0073]
number
[0074] FIG. 6 is a diagram illustrating an example of intra-planar prediction. The predictive behavior of Equation 1 is illustrated in part (a) of Figure 6. The bottom reference line is the bottom left sample R 0,N+1 The top and bottom reference lines are interpolated to obtain the predicted samples using Eq.
[0075]
number
[0076] The rightmost reference column is the top-rightmost pixel R as shown in part (b) of Figure 6. 0,N+1 The prediction operation in Equation 2 involves linear interpolation of the left-most and right-most reference columns, and the predicted value
[0077]
number
[0078] Generate two predicted values
[0079]
number
[0080] and
[0081]
number
[0082] are averaged as in Equation 3 to generate the (eg, final) predicted block.
[0083] Merge Mode in HEVC FIG. 7 is a diagram illustrating the locations of adjacent spatial candidates.
[0084] In the HEVC standard, the set of possible candidates in merge mode can consist of any number of spatially adjacent candidates, (e.g., one) temporally adjacent candidate, and any number of generated candidates. Referring to Figure 7, the locations of five spatial candidates are shown.
[0085] The list of merge candidates may be constructed by (e.g., first) examining five spatial candidates and adding them to the list in the following order: A1, B1, B0, A0, and B2. If the block located at (e.g., one) spatial location is either intra-coded or outside the boundaries of the current slice, the block may be considered unavailable. For example, any redundant entries whose candidates have the same motion information as existing candidates may be (e.g., further) removed from the list to remove spatial candidate redundancy.
[0086] Temporal candidates may be generated and included in a merge candidate list. That is, after including all valid spatial candidates in the merge candidate list, temporal candidates may be generated from motion information of co-located blocks in co-located reference pictures, for example, by using the TMVP (Temporal Motion Vector Prediction) technique. In addition, in the HEVC standard, the size N of the merge candidate list may be set to 5. If the number of merge candidates (e.g., including spatial and / or temporal candidates) is greater than N, only the first N-1 spatial and temporal candidates may be retained in the list. Otherwise, if the number of merge candidates is less than N, some combined candidates and zero candidates may be added to the candidate list until the number of candidates reaches the size N.
[0087] Sub-block-based Temporal Motion Vector Prediction (SbTMVP) VTM-3.0, the latest version of VTM-1.0, includes the SbTMVP (Subblock-based temporal motion vector prediction) method. Similar to the TMVP method, SbTMVP may (1) use a motion field in a co-located picture to improve motion vector prediction, for example, and (2) use a merge mode for the CU in the current picture. Furthermore, SbTMVP may use the same co-located picture as used by TMVP. However, there are two main aspects in which SbTMVP differs from TMVP: (1) TMVP predicts motion at the CU level, while SbTMVP predicts motion at the sub-CU level (e.g., the sub-CU size in SbTMVP may be fixed at 8x8), and (2) TMVP may fetch temporal motion vectors from a co-located block in the co-located picture (e.g., the bottom-right block or the center block relative to the current CU). That is, SbTMVP may apply a motion shift before fetching temporal motion information from the co-located picture. In the above case, the motion shift may be obtained from a motion vector belonging to one of the spatial neighboring blocks of the current CU.
[0088] FIG. 8 is a diagram illustrating an example of a block.
[0089] Referring to FIG. 8, the SbTMVP process may predict a motion vector of a sub-CU within a current CU using the following two steps. Step 1: The spatial neighbors (shown in FIG. 7) are examined in the order of A1, B1, B0, and A0. The first spatial neighboring block with a motion vector using the co-located picture as a reference picture is encountered and / or identified. The motion vector is selected and applied as a motion shift. If the spatial neighbors do not exist for the given CU, the motion shift is set to (0,0). In the scenario illustrated by the left half of FIG. 8, A1 is the spatial neighboring block that provides the selected motion shift. Step 2: The motion shift (e.g., obtained in step 1) is applied (e.g., added to the coordinates of the current block) to obtain sub-CU-level motion information (e.g., including a motion vector and a reference index) from the co-located picture. For example, the right half of FIG. 8 illustrates the motion to be applied based on the assumption that the motion shift is set to A1's motion. The motion information of each sub-CU is derived using the motion information of the corresponding block in the co-located picture.
[0090] When the motion information of the co-located sub-CU is identified (e.g., as soon as the information is identified), the motion information may be converted into a motion vector and reference index of the current sub-CU. For example, the motion information may be converted in a manner similar to the TMVP processing of HEVC, where temporal motion scaling is applied to align the reference picture of the temporal motion vector with the reference picture of the current CU.
[0091] Inter and Intra Combined Merge Mode The inter and intra combined merge mode combines intra prediction with merge indexed prediction. For merge CU, a flag signaling true indicates that the intra mode must be selected from the intra candidate list. For the luma component, the intra candidate list may be derived from four intra modes including DC, planar, horizontal, and vertical modes, and the size of the list may be, for example, 3 or 4 according to the block shape.
[0092] If the width of the CU is greater than twice the height of the CU, the horizontal mode may be excluded from the intra-mode list; similarly, if the height of the CU is greater than twice the width of the CU, the vertical mode may be excluded from the intra-mode list. The intra-prediction mode selected by the intra-mode index and the merge index prediction selected by the merge index are (e.g., then) combined using a weighted average. Equal weights may be selected if DC mode or planar mode is selected, or if the width or height of the CB is less than 4. For chroma components, direct mode (DM) may be applied (e.g., always) without additional signaling.
[0093] In intraplanar mode, samples within a PU may be interpolated using reference samples along the boundaries, including the leftmost, rightmost, topmost, and bottommost boundaries bordering the PU. If the rightmost and bottommost neighboring PUs have not yet been encoded, the associated rightmost and bottommost reference lines are not available. Instead, the associated rightmost and bottommost reference lines may be predicted by replicating the top-rightmost and bottom-leftmost samples of the PU, respectively, as shown in parts (a) and (b) of Figure 6. The above coarse approximation may result in poor prediction quality, which may (e.g.) affect overall compression performance.
[0094] Planar Merge Mode According to an aspect, the planar merge mode may include features of either the intra-planar prediction or the inter-merge mode. According to an aspect, for example, an improved intra-planar prediction scheme may be provided for intra CUs in inter pictures to improve compression performance. According to an aspect, the improved intra-planar prediction scheme for intra CUs in inter pictures may improve what was previously a coarse approximation that resulted in poor prediction quality and affected compression performance. According to an aspect, motion information from spatial neighbors of a (e.g., given) intra CU may be used to derive right and bottom reference lines. According to an aspect, in inter pictures, the just-mentioned temporally derived reference samples may be highly correlated with actual samples, for example, improving the accuracy of intra-planar prediction.
[0095] According to an aspect, any of a CU-based scheme, a sub-block-based scheme, and a modified intra-planar scheme may be used to improve the accuracy of intra-planar prediction, for example, in inter-pictures. According to an aspect, the CU-based scheme for deriving one or more reference lines may include using motion information from spatial neighbors. According to an aspect, the sub-block-based scheme for deriving one or more reference lines for a sub-block may include using motion information obtained from SbTMVP processing. According to an aspect, the modified intra-planar scheme may use (e.g., new) reference lines generated by the CU-based and sub-block-based schemes for intra-planar prediction, either at the CU level or the sub-block level.
[0096] CU-based approach Figure 9 is a diagram illustrating a CU according to an embodiment. Figure 10 is a diagram illustrating determining bottom and right reference lines according to an embodiment.
[0097] According to an embodiment, in a CU-based scheme, the right and bottom reference lines of an intra CU may be derived using motion information of spatial neighbors. Referring to Figure 9, a CU may have a width W and a height H. According to an embodiment, the top and left reference lines may be obtained using a similar (e.g., the same) approach as in the intraplanar mode, as described hereinabove. According to an embodiment, for example, the bottom and right reference lines of the CU shown in Figure 9 may be predicted as described below with respect to performing (1) bottom reference line prediction and (2) right reference line prediction.
[0098] According to an embodiment, in the case of predicting a lower reference line, the availability of the left candidate A1 may be checked (e.g., first), and the availability of the bottom-left candidate A0 may be checked (e.g., next). According to an embodiment, the motion information of the first available candidate may be selected and used to temporally predict a block of size W×(H+HB) by motion compensation, as shown in part (a) of FIG. 10, where HB may be greater than or equal to 1. According to an embodiment, a horizontal line in the (H+1) row may be selected (e.g., next) as the lowermost reference line, for example, assuming that rows are indexed from the topmost row starting with index 1.
[0099] According to an embodiment, in the case of prediction of the right reference line, the availability of the upper spatial candidate B1 may be checked (e.g., first), and the availability of the bottom-rightmost candidate B0 may be checked (e.g., next). According to an embodiment, the motion information of the first available candidate may be selected and used to temporally predict a block of size (W+WR)×H by motion compensation, as shown in part (b) of Figure 11, where WR may be greater than or equal to 1. According to an embodiment, a vertical line in the (W+1) row may be selected as the rightmost reference line, for example, assuming that columns are indexed from the leftmost starting with index 1.
[0100] According to an embodiment, if no A0, A1, B0, and B1 candidates are available, then other spatial and temporal CU merge candidates may be considered. According to an embodiment, if no CU-level merge candidates are available, then planar merge mode may be disabled for a given CU. According to an embodiment, if one (e.g., only one) candidate is available (e.g., only A1), then the reference line without a candidate (e.g., the rightmost reference line) may use the same motion information as the available candidate. According to an embodiment, planar merge mode may be disabled if none of the above candidates and the candidate to the left are available. For example, if both A0 and A1 are unavailable, planar merge mode may be disabled for a given CU. According to an embodiment, the order of testing available spatial candidates may be modified, for example, candidate A0 may be tested before candidate A1, and / or candidate B0 may be tested before candidate B1.
[0101] FIG. 11 is a diagram illustrating a CU-based scheme according to an embodiment.
[0102] According to an aspect, in another CU-based approach, motion-derived reference lines may be adaptively selected by an encoder. For example, according to an aspect, for a certain CU, the encoder may select (e.g., determine, configure, etc.) to derive either (e.g., both) of the rightmost and bottom reference lines using the motion derived scheme described above. According to an aspect, for other CUs, as illustrated in FIG. 11, the encoder may use motion derivation for one of the reference lines (e.g., the right reference line) and may use an intraplanar approach (e.g., duplication of available reference samples) to derive the other reference line (e.g., the bottom reference line). According to an aspect, the approach may use (e.g., require, request) signaling, and discussion regarding signaling (e.g., the above, additional, etc.) may be found further below.
[0103] According to an aspect, in the case of the inter and intra combined merge mode described above, the candidate list of intra modes may be modified to include a planar merge mode. According to an aspect, the planar merge mode may replace the original planar mode in the list. According to an aspect, if the number of intra candidates is less than four, e.g., due to the size of the CU, the planar merge mode may be added to the list without replacing the original planar mode. According to an aspect, in the above case, the planar merge mode may be placed after the original planar mode in the candidate list. According to an aspect, if a planar merge mode index is signaled, the planar merge mode prediction may be combined with the merge index prediction using either equal weighting or unequal weighting.
[0104] Sub-block based approach FIG. 12 is a diagram illustrating a CU having four sub-blocks according to an embodiment.
[0105] According to an embodiment, in a subblock-based scheme, a CU may consist of subblocks, and planar prediction may be performed for each subblock. According to an embodiment, planar prediction for each subblock may be performed (e.g., first) by determining its associated right and bottom reference lines. Referring to FIG. 12, CUs are labeled "A," "B," "C," and "D," each of size W S ×H S According to an aspect, the size of the sub-blocks may be set to 8x8, which is the same as the size of the sub-CU in the VTM. According to an aspect, for each sub-block, motion information may be determined using the SbTMVP processing described above.
[0106] FIG. 13 is a diagram illustrating reference lines of sub-blocks according to an embodiment.
[0107] According to an embodiment, for sub-block “A”, as shown in FIG. 13, the SbTMVP-derived sub-block motion information is calculated using motion compensation to obtain a sub-block of size (W S +W R )×(H S +H B ) block. According to an aspect, the (e.g., next) most right and bottom reference lines may be used to predict the block (W S +1) column and (H S +1) row. R and H B can be 1 or greater.
[0108] FIG. 14 is a diagram illustrating reference lines of sub-blocks according to an embodiment.
[0109] According to an embodiment, for sub-block "B," the associated right and bottom reference lines may be derived according to a process similar to that described above for sub-block "A." For example, as shown in part (a) of FIG. 14, the same left reference line used by "A" may be used for sub-block "B," however, said reference line may be much further away (e.g., even farther) from "B." According to an embodiment, for example, the left reference line may be derived using motion information of the sub-block, and the resulting left reference line is adjacent to sub-block "B," as shown in part (b) of FIG. 14. According to an embodiment, in the above case during motion compensation, the size (W L +W S +W R )×(H S +H B ) may be obtained and the left reference line may be selected (e.g., next).
[0110] FIG. 15 is a diagram illustrating reference lines of sub-blocks according to an embodiment.
[0111] According to an embodiment, for sub-block "D," the left and top reference lines are positioned, for example, farther away from the sub-block, as illustrated in portion (a) of Figure 15. According to an embodiment, for example, the left and top reference lines may be (e.g., further) derived using motion information, resulting in reference lines adjacent to the sub-block, as shown in portion (b) of Figure 15.
[0112] According to an aspect, to reduce memory access bandwidth for either (e.g., both) CU-based and sub-block-based approaches, motion vectors used to derive right-most and bottom-most reference samples for planar prediction may be rounded to integer motion. According to an aspect, unidirectional prediction (e.g., unidirectional prediction only) may be used to generate reference samples (e.g., as described above) even when, for example, an inter-merge candidate is bidirectionally predictive. As another example, according to an aspect, reference pictures in the two lists that are closer to the current picture may be selected for motion compensation. In the above case, for example, integer motion and unidirectional prediction may be combined to further reduce memory bandwidth.
[0113] Modified intraplanar prediction According to an embodiment, the modified intraplanar prediction may be performed, for example, after the rightmost and bottommost reference samples are determined according to the embodiment described above. According to an embodiment, the samples within a CU may be predicted according to the following Equations 4 to 6.
[0114]
number
[0115]
number
[0116]
number
[0117] where Right and Bottom are the right and bottom reference lines, respectively. The other notations in Equations 4-6 may be the same as those described above.
[0118] Signaling for the new planar mode According to an aspect, the planar merge mode may be applied to the luma component (e.g., limited to only the luma component). According to an aspect, the planar merge mode may be applied to both the luma and chroma components. According to an aspect, when the planar merge mode is limited to only the luma component, the direct mode (DM) in chroma may only use normal planar mode, but the associated luma block may use planar merge mode.
[0119] FIG. 16 illustrates a flowchart for signaling a planar merge mode flag according to an embodiment.
[0120] According to an aspect, a flag associated with the planar merge mode may be signaled. According to an aspect, a flag associated with the planar merge mode may be signaled when a condition is satisfied. For example, referring to Figure 16, the planar merge mode flag may be signaled according to (e.g., based on) any (e.g., all) of the following conditions being satisfied: (1) the current slice is an inter slice (P slice or B slice), (2) the current CU is an intra CU, (3) the intra mode is a planar mode, and (4) neighboring motion information is available.
[0121] According to an embodiment, for the CU-based scheme described above, the last condition above (e.g., condition 4) may check (e.g., determine) whether spatially adjacent candidates are available. According to an embodiment, the above check (e.g., determine) may be performed if both the top spatial candidate (e.g., at least one of B0 or B1) and the left spatial candidate (e.g., at least one of A0 or A1) are available. According to an embodiment, the check (e.g., determine) may be performed if any (e.g., one) spatial candidate is available.
[0122] According to an aspect, for the sub-block-based scheme described above, the last condition (e.g., condition 4) may check whether valid motion information is available to derive motion information for the sub-block. According to an aspect, if all the above conditions are met, a planar merge flag may be signaled. According to an aspect, if the planar merge mode is enabled, a CU-level flag equal to 1 may be signaled in the bitstream, and otherwise a CU-level flag equal to 0 may be signaled in the bitstream.
[0123] FIG. 17 illustrates a flowchart for signaling a planar merge mode flag according to an embodiment.
[0124] According to an aspect, a CU-level flag may be signaled if any number of conditions are met (e.g., more or less than the number of conditions shown in FIG. 16). For example, with reference to FIG. 17, a planar merge mode flag may be sent as soon as three conditions are met.
[0125] FIG. 18 illustrates a flowchart for signaling for a CU-based scheme according to an embodiment.
[0126] According to an aspect, a CU-based scheme may adaptively select reference lines to be derived using motion information according to the aspects described above. According to an aspect, the CU-based scheme may use (e.g., require, request) signaling to indicate which of the right, bottom, or both reference lines may be derived (e.g., should be derived), as shown in Figure 18. According to an aspect, the just-described CU-based scheme may increase the number of CU-level flags that may be signaled to three.
[0127] FIG. 19 illustrates a flowchart for signaling an adaptive scheme according to an embodiment.
[0128] According to an aspect, for each CU, the encoder may adaptively select between the CU-based approach and the sub-block-based approach, for example, based on a rate-distortion cost. According to an aspect, the above adaptive scheme may use (e.g., requires, requests, etc.) an additional CU-level flag that is signaled, as shown in FIG. 19. According to an aspect, one value of the flag (e.g., flag=1) may indicate the CU-based approach, and the other value of the flag (e.g., flag=0) may indicate the sub-block-based approach.
[0129] Encoder mode selection According to an embodiment, the encoder may always include the planar merge mode as a candidate during intra mode selection at a rate-distortion (RD) cost. According to an embodiment, the planar merge mode may initially be compared to other intra modes using, for example, a sum of absolute transformed difference (SATD) cost to select a subset of candidate modes to be further compared using the RD cost. During the initial candidate selection process (e.g., selecting a subset of candidate modes) described above, the planar merge mode may result in a higher SATD cost and may not be selected for further testing using, for example, the RD cost.
[0130] Improved Intra-Angular Prediction 20 and 21 are diagrams illustrating intra angular prediction according to an embodiment.
[0131] According to an embodiment, for intra-angular prediction, samples from the upper and / or left reference lines may be used to predict samples within a CU. For example, as shown in FIG. 20, for (e.g., one) prediction direction, sample "P" in a CU may be predicted using sample "X" in (e.g., from) the upper reference line. For larger CUs, for example, because they are further away from the top and left most reference lines, there may be less accuracy for intra-angular prediction of samples closer to the right and bottom most boundaries. According to an embodiment, the right and bottom reference lines may be predicted as shown in FIG. 21 according to the embodiment described above.
[0132] According to an aspect, a sample in a CU may be predicted by taking a weighted average of a sample belonging to the top / leftmost reference line and a sample belonging to the right / bottommost reference line. An example is provided in FIG. 21. For example, according to an aspect, sample "P" may be predicted by taking a weighted average of the topmost reference sample "X" and the rightmost reference sample "R". According to an aspect, the position of reference sample "R" may be determined by (e.g., according to, based on, etc.) the prediction direction (e.g., a selected directional intra-prediction mode) and the position of sample "P". If the position of reference sample "R" is at a fractional sample position (e.g., having, is, etc.), its value may be interpolated from neighboring reference samples. According to an aspect, the weight used to average "X" and "R" may be selected based on, for example, their relative distance from sample "P", or equal weights may be selected. According to an aspect, the intra-angular mode described herein may also be referred to as an angular merge mode.
[0133] According to an aspect, signaling for the angular merge mode may be similar to signaling for the planar merge mode as described above. According to an aspect, a flag (e.g., for signaling the angular merge mode) may be signaled according to (e.g., satisfying) any of the following conditions: (1) the current slice is an inter slice (e.g., a P slice or a B slice), (2) the current CU is an intra CU, (3) the intra mode is an angular mode, and (4) neighboring motion information is available. According to an aspect, for example, the flag may be set to 1 if the angular merge mode is selected, and otherwise the flag may be set to 0, or vice versa.
[0134] According to an aspect, signaling overhead may be reduced. According to an aspect, angular merge mode may be applied to CUs that are larger, e.g., have widths and / or heights that exceed (e.g., a certain) threshold. According to an aspect, the threshold for applying angular merge mode may be predetermined, configured, calculated, etc. According to an aspect, angular merge mode may be limited to CUs whose area (e.g., width multiplied by height) exceeds a threshold. According to an aspect, the threshold for limiting application of angular merge mode may be predetermined, configured, calculated, signaled, etc.
[0135] According to an embodiment, the DC mode may be refined using right and bottom reference lines, which may be derived from neighboring motion information, similar to, for example, the planar merge mode. According to an embodiment, for the DC mode, the DC prediction sample may be the average of the samples in the leftmost, top, right, and bottom reference lines. According to an embodiment, for a non-square CU, the average of two longer reference lines (e.g., (1) the top and bottom reference lines, or (2) the left and right reference lines) may be used as the DC prediction.
[0136] conclusion Although features and elements are described above in particular combinations, those skilled in the art will understand that each feature or element can be used alone or in any combination with the other features and elements. In addition, the methods described herein may be implemented in a computer program, software, or firmware embodied in a computer-readable medium for execution by a computer or processor. Examples of non-transitory computer-readable storage media include, but are not limited to, ROM (described), RAM (random access memory), registers, cache memory, semiconductor memory devices, magnetic media such as internal hard disks and removable disks, and optical media such as magneto-optical media, e.g., CD-ROM disks and digital versatile disks (DVDs). A processor associated with software may be used to implement a radio frequency transceiver for use in a UE, a WTRU, a terminal, a base station, an RNC, or any host computer.
[0137] Furthermore, in the above-described aspects, processing platforms, computing systems, controllers, and other devices, including constraint servers and rendezvous points / servers, that include processors are prominent. The just-mentioned devices may include at least one "CPU" (Central Processing Unit) and memory. In accordance with the practices of those skilled in the art of computer programming, references to operations and symbolic representations of operations or instructions may be performed by various CPUs and memories. Such operations and operations or instructions may be referred to as being "executed," "computer-executed," or "CPU-executed."
[0138] Those skilled in the art will understand that the operations and symbolically represented operations or instructions include the manipulation of electrical signals by a CPU. The electrical system reconfigures or otherwise alters the operation of the CPU, as well as the processing of other signals, by representing data bits that can cause the resulting transformation or reduction of the electrical signals and the retention of the data bits in memory locations in a memory system. The memory locations where the data bits are maintained are physical locations that have particular electrical, magnetic, optical, or organic properties that correspond to or represent the data bits. It should be understood that the exemplary embodiments are not limited to the platforms or CPUs described above, and that other platforms and CPUs may support the provided methods.
[0139] Additionally, data bits may be maintained on computer-readable media, including magnetic disks, optical disks, and any other volatile (e.g., Random Access Memory ("RAM")) or non-volatile (e.g., Read-Only Memory ("ROM")) mass storage system that is readable by a CPU. Computer-readable media may include computer-readable media that reside exclusively in a processing system, or that are distributed among, cooperating with, or interconnected to multiple interconnected processing systems, which may be local or remote to a processing system. It will be understood that exemplary embodiments are not limited to the memories described above, and that other platforms and memories may support the described methods.
[0140] In an exemplary aspect, any of the operations, processes, etc. described herein may be implemented as computer-readable instructions stored on a computer-readable medium, which may be executed by a processor in a mobile unit, a network element, and / or any other computing device.
[0141] Few distinctions remain between hardware and software implementations of system aspects. The use of hardware or software is generally (though not always, in that the choice between hardware and software can be important in some situations) a design choice representing a cost vs. efficiency trade-off. There may be various means (e.g., hardware, software, and / or firmware) by which the processes and / or systems and / or other techniques described herein may be achieved, and the preferred means may vary depending on the context in which the processes and / or systems and / or other techniques are deployed. For example, if an implementer determines that speed and accuracy are most important, the implementer may opt for a primarily hardware and / or firmware implementation. If flexibility is most important, the implementer may opt for a primarily software implementation. Alternatively, the implementer may opt for a combination of hardware, software, and / or firmware.
[0142] The foregoing detailed description has set forth various aspects of devices and / or processes through the use of block diagrams, flowcharts, and / or examples. To the extent that the block diagrams, flowcharts, and / or examples include one or more functions and / or operations, those skilled in the art will appreciate that each function and / or operation within the block diagrams, flowcharts, or examples, individually and / or collectively, can be implemented by a wide range of hardware, software, firmware, or virtually any combination thereof. By way of example, suitable processors include general-purpose processors, special-purpose processors, conventional processors, digital signal processors (DSPs), multiple microprocessors, one or more microprocessors in conjunction with a DSP core, controllers, microcontrollers, application-specific integrated circuits (ASICs), application-specific standard products (ASSPs), field-programmable gate array (FPGA) circuits, any other type of integrated circuit (IC), and / or state machines.
[0143] Although features and elements are provided above in particular combinations, those skilled in the art will understand that each feature or element can be used alone or in any combination with other features and elements. The present disclosure should not be limited to the specific embodiments described in this application, but rather as illustrations of various aspects. Many modifications and variations can be made without departing from its spirit and scope, as will be apparent to those skilled in the art. No element, act, or instruction used in the description of this application should be construed as critical or essential to the invention unless explicitly provided as above. Functionally equivalent methods and apparatuses within the scope of the present disclosure, in addition to those recited herein, will be apparent to those skilled in the art from the foregoing description. Such modifications and variations are intended to fall within the scope of the appended claims. The present disclosure should be limited only by the appended claims, along with the full scope of equivalents to which such claims are entitled. It should be understood that the present disclosure is not limited to any particular method or system.
[0144] Furthermore, it should be understood that the terminology used herein is used only for the purpose of describing particular aspects and is not intended to be limiting. As used and referred to herein, the term "user equipment" and the abbreviation "UE" can mean (i) a wireless transmit and / or receive unit (WTRU), e.g., in the described infrastructure; (ii) any of numerous aspects of a WTRU, e.g., in the described infrastructure; (iii) a wireless and / or wired device (e.g., capable of being connected) configured with, among other things, some or all of the structure and functionality of a WTRU, e.g., in the described infrastructure; (iii) a wireless and / or wired device configured with less than all of the structure and functionality of a WTRU, e.g., in the described infrastructure; or (iv) the like. Details of an exemplary WTRU may refer to any WTRU described herein.
[0145] In certain exemplary embodiments, some portions of the subject matter described herein may be implemented via ASICs (Application Specific Integrated Circuits), FPGAs (Field Programmable Gate Arrays), DSPs (Digital Signal Processors), and / or other integrated formats. However, those skilled in the art will recognize that some aspects of the embodiments disclosed herein may equivalently be implemented, in whole or in part, in an integrated circuit, as one or more computer programs executing on one or more computers (e.g., as one or more programs executing on one or more computer systems), as one or more programs executing on one or more processors (e.g., as one or more programs executing on one or more microprocessors), as firmware, or as substantially any combination thereof, and that designing circuitry and / or writing software and / or firmware code is well within the skill of those skilled in the art in light of this disclosure. Additionally, those skilled in the art will understand that the mechanisms of the subject matter described herein may be distributed as a program product in various forms, and that the exemplary embodiments of the subject matter described herein apply regardless of the particular type of signal-bearing medium used to actually effect the distribution. Examples of signal-bearing media include, but are not limited to, the following: recordable-type media such as, for example, floppy disks, hard disk drives, CDs, DVDs, digital tape, computer memory, and the like; and transmission-type media such as, for example, digital and / or analog communications media (e.g., fiber optic cables, wave guides, wired communications links, wireless communications links, and the like).
[0146] The subject matter described herein sometimes illustrates different components contained within or connected to different other components. It should be understood that the depicted structures above are merely examples, and that many other structures that achieve the same functionality may actually be implemented. In a conceptual sense, any arrangement of components that achieve the same functionality is effectively "associated" such that the desired functionality can be achieved. Thus, any two components that combine to achieve specific functionality herein may be understood as being "associated" with each other such that the desired functionality is achieved regardless of structure or intermediate components. Similarly, any two components so associated may also be considered to be "operably connected" or "operably coupled" to each other to achieve the desired functionality, and any two components capable of being so associated may also be considered to be "operably coupleable" to each other to achieve the desired functionality. Specific examples of operably coupleable include, but are not limited to, physically matable and / or physically interacting components, wirelessly interacting and / or wirelessly interacting components, and / or logically interacting and / or logically interacting components.
[0147] With respect to the use of substantially any plural and / or singular term herein, those skilled in the art will be able to convert from plural to singular and / or from singular to plural as appropriate to the context and / or application. Various singular / plural permutations may be expressly set forth herein for purposes of clarity.
[0148] It will be understood by those skilled in the art that the terms used herein, in general, and in the appended claims in particular (e.g., the body of the appended claims), are generally intended as "open" terms (e.g., the term "comprising" should be interpreted as "including but not limited to," the term "having" should be interpreted as "having at least," the term "including" should be interpreted as "including but not limited to," etc.). It will be further understood by those skilled in the art that if a specific number of recitations in a submitted claim are intended, such intention will be explicitly set forth in the claim, and that such intention would not be given absent such recitation. For example, where only one item is intended, "single" or similar language may be used. As an aid to understanding, the following appended claims and / or description herein may include the use of the introductory phrases "at least one" and "one or more" to submit claim recitations. However, the use of the above phrases should not be construed as meaning that filing a claim statement with the indefinite article "a" or "an" limits any particular claim that includes the above-filed claim statement to embodiments that include only one such statement, even when the same claim includes the preface phrase "one or more" or "at least one" and an indefinite article such as "a" or "an" (e.g., "a" and / or "an" should be interpreted to mean "at least one" or "one or more"). The same holds true for the use of definite articles used to file a claim statement. In addition, even when a specific number of statements in a filed claim is explicitly recited, those skilled in the art will recognize that the recitation should be interpreted to mean at least the recited number (e.g., the mere recitation of "two statements" without any other modifiers means at least two statements, or two or more statements).Furthermore, in instances where a convention similar to "at least one of A, B, and C, etc." is used, the above configuration is generally intended in the sense that one of ordinary skill in the art would understand the convention (e.g., "a system having at least one of A, B, and C" includes, but is not limited to, systems having A only, B only, C only, A and B together, A and C together, B and C together, and / or A, B, and C together, etc.). In instances where a convention similar to "at least one of A, B, or C, etc." is used, the above configuration is generally intended in the sense that one of ordinary skill in the art would understand the convention (e.g., "a system having at least one of A, B, or C" includes, but is not limited to, systems having A only, B only, C only, A and B together, A and C together, B and C together, and / or A, B, and C together, etc.). It will be further understood by those skilled in the art that any disjunctive word and / or phrase providing two or more alternative terms, whether in the specification, claims, or drawings, should be understood to contemplate the possibility of including one of the terms, either term, or both terms. For example, the phrase "A or B" will be understood to include the possibilities of "A" or "B" or "A and B." Furthermore, as used herein, the term "any of" followed by a description of multiple items and / or multiple groups of items is intended to include "any of," "any combination of," "any more of," and / or "combination of any more of" the items and / or groups of items, either individually or in conjunction with other items and / or other groups of items. Furthermore, as used herein, the term "set" or "group" is intended to include any number of items, including zero. Additionally, as used herein, the term "number" is intended to include any number, including zero.
[0149] Additionally, where features or aspects of the present disclosure are described in terms of a Markush group, those skilled in the art will further appreciate that the present disclosure is thereby described in terms of any individual element of an element of a Markush group or subgroup of elements of a subgroup.
[0150] As will be understood by those skilled in the art, for any and all purposes, including, for example, with respect to providing a written description, all ranges disclosed herein also include any and all possible subranges and combinations of those subranges. Any range described can be readily recognized as being fully described and that the same range can be at least equally broken down into halves, thirds, quarters, fifths, tenths, etc. As a non-limiting example, each range described herein can be readily broken down into lower, middle, and upper thirds, etc. As will be further understood by those skilled in the art, all terms, such as "up to," "at least," "greater than," "less than," etc., refer to ranges that are inclusive of the recited number and can subsequently be broken down into subranges as described above. Finally, as will be understood by those skilled in the art, a range includes each individual element. Thus, for example, a group having 1 to 3 cells refers to a group having 1, 2, or 3 cells. Similarly, a group having 1 to 5 cells refers to groups having 1, 2, 3, 4, or 5 cells, and so on.
[0151] Furthermore, the claims should not be read as limited to the order or elements presented unless expressly stated to the contrary. Additionally, the use of the term "means for" in any claim is intended to invoke 35 U.S.C. § 112(6) or means-plus-function claim format, and any claim without the term "means for" does not have such an intention.
[0152] A processor in association with software may be used to implement a radio frequency transceiver for use in a wireless transmit receive unit (WTRU), user equipment (UE), terminal, base station, Mobility Management Entity (MME) or Evolved Packet Core (EPC), or any host computer. The WTRU may be used in combination with hardware and / or software including software defined radios (SDRs) and modules implemented in other components, such as, for example, a camera, a video camera module, a video phone, a speakerphone, a vibration device, a speaker, a microphone, a television walkie-talkie, a hands-free headset, a keyboard, a Bluetooth™ module, a frequency modulation (FM) radio unit, a near field communication (NFC) module, a liquid crystal display (LCD) display unit, an organic light-emitting diode (OLED) display unit, a digital music player, a media player, a video game player module, an internet browser, and / or a wireless local area network (WLAN) or ultra wide band (UWB) module.
[0153] Although the present invention has been described with respect to a communications system, it is envisioned that the system may be implemented in software on a microprocessor / general purpose computer (not shown). In some aspects, one or more of the functions of the various components may be implemented in software controlling the general purpose computer.
[0154] Additionally, while the invention is illustrated and described herein with reference to specific embodiments, the invention is not intended to be limited to the details shown. Rather, various changes may be made in the details within the scope and range of equivalents of the claims and without departing from the invention. [Explanation of symbols]
[0155] 100 Communication Systems 104 RAN 106 Core Network 108 PSTN 110 Internet 112 other networks 114a base station 114b base station 116 Air Interface 118 processors 120 Walkie-Talkie 122 receiving element 124 microphones 126 keypad 128 Touchpad 130 Memory 132 Memory 134 Power supply 136 GPS chipset 138 Peripherals
Claims
1. 1. A method for video encoding, comprising: encoding a current block into a bitstream, said encoding comprising: predicting one or more unreconstructed reference samples based on motion information derived from another block; performing intra prediction of the current block using the predicted one or more reference samples; Including A method comprising:
2. The performing of the intra prediction of the current block includes: generating a predicted sample according to a planar intra prediction mode based on the predicted one or more reference samples; The method of claim 1 further comprising:
3. The performing of the intra prediction of the current block includes: generating a predicted sample according to an angular intra-prediction mode based on the predicted one or more reference samples; The method of claim 1 further comprising:
4. The performing of the intra prediction of the current block includes: generating a predicted sample according to a DC intra prediction mode based on the predicted one or more reference samples; The method of claim 1 further comprising:
5. the current block is a coding unit (CU), The other block is a neighboring block of the current block.
2. The method of claim 1 .
6. 2. The method of claim 1 , wherein the current block is a sub-CU and the other block is a corresponding block from a co-located picture, the corresponding block being determined based on motion information derived from neighboring blocks of the current block.
7. 2. The method of claim 1, wherein the predicted one or more reference samples are from at least one line of reference samples, the line of reference samples being arranged along the right edge of the current block, the bottom edge of the current block, the left edge of the current block, or the top edge of the current block.
8. 1. A method for video decoding, comprising: decoding a current block from a bitstream, said decoding comprising: predicting one or more unreconstructed reference samples based on motion information derived from another block; performing intra prediction of the current block using the predicted one or more reference samples; Including A method comprising:
9. The performing of the intra prediction of the current block includes: generating a predicted sample according to a planar intra prediction mode based on the predicted one or more reference samples; 9. The method of claim 8, further comprising:
10. The performing of the intra prediction of the current block includes: generating a predicted sample according to an angular intra-prediction mode based on the predicted one or more reference samples; 9. The method of claim 8, further comprising:
11. The performing of the intra prediction of the current block includes: generating a predicted sample according to a DC intra prediction mode based on the predicted one or more reference samples; 9. The method of claim 8, further comprising:
12. decoding a syntax element from the bitstream indicating that decoding the current block will be performed in accordance with the predicting and performing. The method of claim 8 further comprising:
13. decoding a syntax element from the bitstream, the syntax element indicating whether the predicted one or more reference samples are from a reference line below, a reference line to the right, or both; The method of claim 12 further comprising:
14. decoding a syntax element from the bitstream, the syntax element indicating whether the current block is a CU or a sub-CU; The method of claim 12 further comprising:
15. 1. An apparatus for video encoding, comprising: at least one processor; a memory storing instructions that, when executed by the at least one processor, cause the apparatus to encode a current block into a bitstream, the encoding comprising: predicting one or more unreconstructed reference samples based on motion information derived from another block; performing intra prediction of the current block using the predicted one or more reference samples; Including memory and An apparatus comprising:
16. The performing of the intra prediction of the current block includes: generating a predicted sample according to a planar intra prediction mode based on the predicted one or more reference samples; 16. The apparatus of claim 15, further comprising:
17. The performing of the intra prediction of the current block includes: generating a predicted sample according to an angular intra-prediction mode based on the predicted one or more reference samples; 16. The apparatus of claim 15, further comprising:
18. The performing of the intra prediction of the current block includes: generating a predicted sample according to a DC intra prediction mode based on the predicted one or more reference samples; 16. The apparatus of claim 15, further comprising:
19. 1. An apparatus for video decoding, comprising: at least one processor; a memory storing instructions that, when executed by the at least one processor, cause the device to decode a current block from a bitstream, the decoding comprising: predicting one or more unreconstructed reference samples based on motion information derived from another block; performing intra prediction of the current block using the predicted one or more reference samples; Including memory and An apparatus comprising:
20. The instruction: decoding a syntax element from the bitstream, and indicating that decoding the current block will be performed in accordance with the predicting and performing; 20. The apparatus of claim 19, further comprising:
21. The instruction: decoding a syntax element from the bitstream, the syntax element indicating whether the predicted one or more reference samples are from a reference line below, a reference line to the right, or both; 21. The apparatus of claim 20, further comprising:
22. The instruction: decoding a syntax element from the bitstream, indicating whether the current block is a CU or a sub-CU; 21. The apparatus of claim 20, further comprising:
Citation Information
Patent Citations
Image processing device and method
WO2017073360A1