Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Method and apparatus of motion vector derivations in immersive video coding

A motion vector, coding technology, applied in the direction of digital video signal modification, electrical components, image communication, etc., can solve problems such as distortion and deformation

Active Publication Date: 2019-03-05
MEDIATEK INC
View PDF3 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

If conventional inter prediction is applied to 2D frames transformed from 3D space, using motion estimation / motion compensation techniques will not work properly because the motion in 3D space will not work properly due to object motion or relative motion between the object and the camera. Objects may become distorted or deformed in 2D frames

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and apparatus of motion vector derivations in immersive video coding
  • Method and apparatus of motion vector derivations in immersive video coding
  • Method and apparatus of motion vector derivations in immersive video coding

Examples

Experimental program
Comparison scheme
Effect test

example 1

[0098]

[0099] Therefore, Δθ'=Δθ;

example 2

[0101]

[0102]

[0103]

example 3

[0104] Example 3: General form of scaling function - projection based

[0105]

[0106]

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

Methods and apparatus of processing 360-degree virtual reality images are disclosed. According to one method, a system that maps a motion vector in a 2D frame into a 3D space and then applies rotationof sphere to adjust motion vector in the 3D space. The rotated motion vector is then mapped back to the 2D frame for processing 360-degree virtual reality images. According to another method, a system that derives motion vector from displacement of viewpoint is disclosed. According to yet another method, a system that applies scaling to adjust motion vector is disclosed. The motion vector scalingcan be performed in the 3D space by projecting a motion vector from a 2D frame to a 3D sphere. After motion vector scaling, the scaled motion vector is projected back to the 2D frame. Alternatively,the forward projection, motion vector scaling and inverse projection can be combined into a single function.

Description

[0001] priority statement [0002] This application claims priority to U.S. Provisional Patent Application No. 62 / 523,883 filed on June 23, 2017 and U.S. Provisional Patent Application No. 62 / 523,885 filed on June 23, 2017. The aforementioned US Provisional Patent Application is hereby incorporated by reference in its entirety. technical field [0003] The present invention relates to image / video processing or encoding and decoding of 360-degree virtual reality (virtual reality, VR) images / sequences. In particular, the present invention relates to deriving motion vectors for three-dimensional (3D) content in different projection formats. Background technique [0004] 360-degree video, also known as immersive video, is an emerging technology that can provide "the feeling of being there". A feeling of immersion is achieved by surrounding the user with a wrap-around scene covering the panoramic view, especially a 360-degree panorama. The "sense of being there" can be furthe...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): H04N19/50
CPCH04N19/597H04N19/55
Inventor 施正轩林建良
Owner MEDIATEK INC
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products