Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Image processing device and method

a processing device and image technology, applied in the field of image processing devices and methods, can solve the problems of high cost calculation, high calculation cost of gradient (g) and velocity (v), which are obtained in bio, and achieve the effect of reducing the buffer siz

Pending Publication Date: 2022-03-03
SONY CORP
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Benefits of technology

The present patent technology aims to reduce the buffer size required for inter prediction processing. This is achieved by calculating the SAD of L0 and L1 prediction blocks for an entire PU and comparing it to a threshold to determine if BIO processing should be applied. By doing so, the processing branches accordingly, allowing for the virtual partition of PUs into multiple vPUs. This reduction in buffer size provides a more efficient and cost-effective solution for inter prediction processing.

Problems solved by technology

Meanwhile, the calculation costs of the gradient (G) and the velocity (V), which are obtained in BIO, are very high.
This is based on a tendency that the velocity (V) is small and BIO is thus not very effective when the SAD value is small, and achieves early termination, that is, eliminates the high cost calculation in a case where the effect is not expected.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Image processing device and method
  • Image processing device and method
  • Image processing device and method

Examples

Experimental program
Comparison scheme
Effect test

first modified example

[0347]In the first embodiment described above, the example in which in a case where PUs are larger than VPDUs, the PU is virtually partitioned into a plurality of vPUs, and a SAD is calculated to determine whether to apply BIO for each vPU is described. The vPUs of the PU are originally included in the same PU, and hence it is conceivable that a certain partial tendency is similar to the tendencies of the different portions.

[0348]FIG. 22 and FIG. 23 are diagrams illustrating, as a first modified example, an example in which in a case where PUs are larger than VPDUs, a BIO determination result for a vPU number of 0 is also used for other vPUs on the premise of the tendency described above.

[0349]In the upper part of FIG. 22, there are illustrated ranges in which SADs have been calculated first for BIO application determination in a case where the CU (PU) is 128×128 and VPDU=64×64 holds. In the case of the CU (PU) of 128×128, of vPUs obtained by partitioning the CU (PU) into four as SA...

second modified example

[0362]FIG. 26 and FIG. 27 are diagrams illustrating, as a second modified example, an example in which whether to apply BIO is determined with a partial SAD value in each vPU.

[0363]In the upper part of FIG. 26, there are illustrated ranges in which SADs have been calculated first for BIO application determination in a case where the CU (PU) is 128×128 and VPDU=64×64 holds. In the case of the CU (PU) of 128×128, a SAD is calculated for an upper left partial region (32×32) of each vPU obtained by partitioning the CU (PU) into two as SAD calculation regions for BIO_vPU_ON determination.

[0364]In the lower part of FIG. 26, there are illustrated ranges in which SADs have been calculated first for BIO application determination in a case where the CU (PU) is 128×64 and VPDU=64×64 holds. In the case of the CU (PU) of 128×64, a SAD is calculated for an upper left partial region (32×32) of each vPU obtained by partitioning the CU (PU) into two as SAD calculation regions for BIO_vPU_ON determin...

second embodiment (

[0419]In a second embodiment, as in the first embodiment, in a case where PUs are larger than VPDUs, the PU is virtually partitioned into vPUs, and the processing is performed in units of vPUs.

[0420]In the second embodiment, unlike the first embodiment, 1 bit of the BIO_PU_ON flag is included in bitstreams that are transmitted / received between the encoding device 1 and the decoding device 101 so that the operation of the encoding device 1 and the operation of the decoding device 101 can be shared.

[0421]FIG. 30 and FIG. 31 are flowcharts illustrating, as an operation example according to the second embodiment of the present technology, BIO-included Bi prediction that is performed by the inter prediction unit 51.

[0422]In Steps S701 to S708 and Steps S715 to S728 of FIG. 30 and FIG. 31, processing basically similar to that in Steps S401 to S408 and Steps S412 to S425 of FIG. 17 and FIG. 18 is performed, and hence the description thereof, which is redundant, is appropriately omitted.

[04...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The present technology relates to image processing device and method that achieve a reduction in a buffer size.The image processing device partitions a unit of processing into partitioned processing units each of which corresponds to a VPDU size or is equal to or smaller than the VPDU size, the unit of processing being used for calculation of a cost that is used for determining whether or not to perform bidirectional prediction. The image processing device makes the determination by using the cost calculated based on the partitioned processing units. The present technology is applicable to encoding devices or decoding devices.

Description

TECHNICAL FIELD[0001]The present technology relates to image processing device and method, in particular, to image processing device and method that achieve a reduction in a buffer size.BACKGROUND ART[0002]The VVC standard that is a next-generation codec has been developed as a successor to AVC / H.264 and HEVC / H.265.[0003]In the VVC standard in which large CUs (Coding Units) up to 128×128 are employed, the concept of VPDUs (Virtual Pipeline Data Units) has also been introduced in consideration of increases in circuit scale and power consumption in HW decoder implementation, in particular.[0004]The VPDU size is a buffer size that allows smooth processing on each pipeline stage. The VPDU size is often set to the maximum size of TUs (Transform Units).[0005]In VVC, the maximum TU size is 64×64, and the same is assumed to hold true for VPDUs. In VVC, one CU corresponds to one PU, and hence inter prediction processing is required to be performed on PUs larger than VPDUs. Even in this case,...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(United States)
IPC IPC(8): H04N19/109H04N19/577H04N19/119H04N19/176H04N19/436
CPCH04N19/109H04N19/577H04N19/436H04N19/176H04N19/119H04N19/433H04N19/567
Inventor HISHINUMA, SINSUKEKONDO, KENJI
Owner SONY CORP
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com