Multi-Encoder High Resolution Video Processing via Cubic Projection Segmentation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video codecs, such as Level 5.2 HEVC, are unable to efficiently process high resolution imaging content like 4K or 8K video at native resolutions and frame rates, leading to incompatible formats and the introduction of image artifacts during stitching.
Innovation Solution
The method involves capturing images in a spherical projection, re-mapping it into an equal area cubic (EAC) projection, and splitting it into segments that can be encoded and decoded using commodity codecs, minimizing lossy encoding and artifacts by handling the original source images within existing codec ecosystems.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If high resolution imaging content is processed using extant video codecs, then compatibility with common computing devices is improved, but image quality deteriorates due to artifacts and lossy encoding
Solution Approach 1:
The spherical projection is divided into multiple cubic projection segments (front, back, left, right, top, bottom faces), each independently encoded using standard video codecs. This segmentation allows compatibility with extant codecs while maintaining overall image quality through lossless reconstruction of the complete spherical projection from the encoded segments
Solution Approach 2:
A cubic projection intermediary format is introduced between the captured spherical projection and the final encoded output. The spherical projection is first transformed into a cubic projection (which can be seamlessly divided into segments), then each segment is independently encoded. This intermediary format enables both compatibility with standard codecs and preservation of image quality through lossless transformation
2Adaptability or versatility
If high resolution content is encoded into multiple segments, then compatibility with extant codecs is improved, but device complexity increases due to multiple encoding processes
Solution Approach 1:
The encoding process is segmented into independent units (cubic projection faces) that can be processed separately by standard video codecs. Each face is encoded independently using conventional codecs, but the overall system maintains simplicity through the regular, predictable structure of the cubic projection segmentation
Solution Approach 2:
The cubic projection format serves multiple functions: it enables segmentation for codec compatibility, provides a regular structure for systematic encoding, and allows flexible reconfiguration for different display formats. This universal format simplifies the overall encoding architecture despite the multi-segment process
3Manufacturing precision
If spherical projection is transformed into cubic projection, then image quality is preserved through lossless transform, but processing time increases due to additional transformation steps
Solution Approach 1:
The spherical to cubic projection transformation is performed as a preliminary step during the encoding process, before segmentation and compression. By establishing the cubic projection structure early, the system enables subsequent independent encoding of each face while preserving the lossless transformation benefits
Data Source
AI summary
Methods and apparatus for multi-encoder processing of high resolution content. In one embodiment, the method includes capturing high resolution imaging content; splitting up the captured high resolution imaging content into respective portions; feeding the split up portions to respective imaging encoders; packing encoded content from the respective imaging encoders into an A/V container; and storing and/or transmitting the A/V container. In another embodiment, the method includes retrieving and/or receiving an A/V container; splitting up the retrieved and/or received A/V container into respective portions; feeding the split up portions to respective imaging decoders; stitching the decoded imaging portions into a common imaging portion; and storing and/or displaying at least a portion of the common imaging portion.