Method and device for parallel coding of panoramic video

A panoramic video and encoding method technology, applied in the field of panoramic video parallel encoding methods and devices, can solve the problems of restricting the large-scale industrial application and popularization of panoramic video, the effect of parallel acceleration is greatly reduced, and the CPU utilization rate is low, so as to promote large-scale Large-scale industrial application and popularization, real-time coding, and the effect of improving coding speed

Active Publication Date: 2016-11-23
BEIJING BYTEDANCE TECH CO LTD
View PDF4 Cites 45 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

In this way, the multi-threading of the multi-core processor cannot simultaneously start encoding the VR video, resulting in the multi-core processor not being able to fully achieve its design performance, and the parallel acceleration effect is greatly reduced with the increase in the number of CPU (central processing unit) cores, for example, For a 4-core CPU, the speedup is usually 2.5 times that of a single-core CPU, and it is very difficult to achieve 3 times. For an 8-core CPU, the speedup is difficult to reach 4 times that of a single-core CPU. increase, the CPU utilization rate will be lower and lower, so the existing WPP encoding method is not conducive to fully utilizing the multi-core processing capability of the CPU, and cannot achieve real-time encoding of panoramic video, which limits the large-scale industrial application of panoramic video and popularity

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and device for parallel coding of panoramic video
  • Method and device for parallel coding of panoramic video
  • Method and device for parallel coding of panoramic video

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0062] figure 2 It is a schematic flow chart of the panoramic video parallel coding method provided by Embodiment 1 of the present invention. Such as figure 2 As shown, the method includes the following steps:

[0063] S201. Obtain a spherical panoramic video.

[0064] S202. Determine whether the mapping method is a preset mapping method, if yes, perform step S203:

[0065] It should be noted that, in the embodiment of the present invention, the preset mapping methods include, but are not limited to, the following mapping methods: cubic projection (Cubic Projection), quadrangular pyramid mapping, and latitude and longitude map mapping. As an example, the preset mapping manner may also include: an Adaptive Tile Segmentation manner, a TBCylinder mapping manner, and a Circle-Tiles Segmentation mapping manner.

[0066] Such as image 3 As shown, the cube mapping method is a mapping method in which a sphere is mapped into a cube and expanded into six positive directions.

...

Embodiment 2

[0088] Figure 8 It is a schematic flow chart of the panoramic video parallel coding method provided by Embodiment 2 of the present invention. Such as Figure 8 As shown, the method includes the following steps:

[0089] S801. Obtain a spherical panoramic video.

[0090] S802. Determine whether the mapping method is a preset mapping method, if yes, execute step S803:

[0091] S803. Map the spherical panoramic video to a planar panoramic video according to a preset mapping method, and divide the planar panoramic video into multiple planar views:

[0092] S804. Determine whether the shapes of the plane views are all rectangles, if not, execute step S805, if yes, execute step S806, if yes, execute step S806:

[0093] S805. Processing the non-rectangular plane view shape into a rectangle:

[0094] As an example, to process a non-rectangular planar view into a rectangle, the following method may be adopted: making a circumscribing rectangle of the non-rectangular planar view. ...

Embodiment 3

[0105] Figure 9 It is a schematic flow chart of the panoramic video parallel encoding method provided by Embodiment 3 of the present invention. Such as Figure 9 As shown, the method includes the following steps:

[0106] S901. Obtaining a spherical panoramic video:

[0107] S902. Determine whether the mapping method is a four-edge quasi-mapping method, and if so, perform step S903:

[0108] S903. Map the spherical panoramic video into a plane panoramic view according to the quadrangular pyramid mapping method, and divide the plane panoramic video into a square view and 4 triangular views:

[0109] It should be noted that, if Figure 4 As shown in , a square view S and four triangular views T1 to T4 are mapped into a large square.

[0110] S904. Stitching four triangular plane views into two square plane views:

[0111] In the embodiment of the present invention, any two triangular views among the four triangular views T1 to T4 can be spliced ​​into one square plan view...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a method and a device for parallel coding of a panoramic video. The method comprises the following steps of acquiring a spherical panoramic video; mapping the spherical panoramic video into a flat panoramic video according to a preset mapping mode, and segmenting the flat panoramic video into a plurality of plane views; recombining the flat panoramic video into a plurality of video sequences, wherein the plane views in each video sequence are plane views which are mapped to the same position and are formed according to time sequence; performing parallel coding on all the video sequences; restoring decoded videos according to positions of respective decoded videos in the flat panoramic video and splicing the restored videos into a complete flat panoramic video; inversely mapping the complete flat panoramic video into the spherical panoramic video. According to the method, the panoramic video can be coded by fully utilizing multi-core processing capacity of a CPU (Central Processing Unit) / GPU (Graphics Processing Unit), the coding speed of the panoramic video is improved, real-time coding of the panoramic video is realized, and large-scale industrial application and generalization of the panoramic video are favorably promoted.

Description

technical field [0001] The present invention relates to the field of virtual reality (Virtual Reality, VR) video technology, in particular to a panoramic video parallel encoding method and device. Background technique [0002] At present, VR (virtual reality) videos on the market are mainly spherical panoramic videos, and the video coverage angle is 360 degrees horizontally and 180 degrees vertically. Compared with normal videos, the file data volume of panoramic videos increases greatly, and network transmission The burden has also increased significantly. [0003] In addition, in order to obtain a VR experience with a better sense of immersion, the panoramic video is required to have a high frame rate (90-120fps), and a high resolution such as 4k, 8k or even higher. This is far beyond the real-time processing capabilities of existing hardware. Therefore, the coding efficiency of panoramic video becomes an important factor determining whether VR video can be quickly appli...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04N21/218H04N21/234H04N19/436
CPCH04N19/436H04N21/21805H04N21/23424
Inventor 姜东侯明强洪定坤
Owner BEIJING BYTEDANCE TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap