EAC Video Segmentation for 8K Codec Bandwidth
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video codecs struggle to efficiently process high-resolution content captured by imaging sensors, such as those in action cameras, due to hardware limitations, leading to suboptimal performance and bandwidth utilization.
Innovation Solution
The method involves capturing image data of a first size, multiplexing it into smaller portions, and encoding these portions at a specific rate to maximize codec throughput, using techniques like equi-angular cubemap projections and staged codec operations to bypass hardware limitations, allowing for the processing of high-resolution content like 8K Cinema video on standard consumer devices.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If image data is captured at high resolution (e.g., 8K), then image quality is improved, but hardware processing capabilities are exceeded
Solution Approach 1:
The patent divides high-resolution image data into multiple smaller portions or tiles that can be processed independently by hardware codecs. This segmentation allows the system to handle 8K resolution by breaking it down into manageable chunks that fit within hardware limitations, enabling high-resolution processing without requiring beyond-capability hardware
2Adaptability or versatility
If software-based processing is used for high-resolution content, then flexibility is improved, but processing speed deteriorates
Solution Approach 1:
By dividing the image into portions and processing them through hardware codecs, the patent achieves both speed and flexibility. The segmented approach allows hardware acceleration for each portion while maintaining the flexibility to handle various resolutions and formats, resolving the contradiction between software flexibility and hardware speed
3Measurement precision
If image data is processed at native high resolution, then image quality is improved, but codec bandwidth utilization deteriorates
Solution Approach 1:
The patent segments high-resolution image data into multiple portions that can be encoded and transmitted more efficiently through the codec. This segmentation optimizes bandwidth utilization by breaking down the data stream into manageable units that better match codec processing capabilities, while still preserving the overall high-resolution quality through proper reconstruction
Solution Approach 2:
The patent transforms the problem from a single high-resolution stream into multiple lower-resolution portions in the spatial dimension. This dimensional change allows better utilization of codec bandwidth by distributing the processing load across multiple streams that collectively represent the original high-resolution content
Data Source
AI summary
Methods and apparatus for processing of video content to optimize codec bandwidth. In one embodiment, the method includes capturing panoramic imaging content (e.g., a 360° panorama), mapping the panoramic imaging content into an equi-angular cubemap (EAC) format, and splitting the EAC format into segments for transmission to maximize codec bandwidth. In one exemplary embodiment, the EAC segments are transmitted at a different frame rate than the subsequent display rate of the panoramic imaging content. For example, the mapping and frame rate may be chosen to enable the rendering of 8K, 360° content at 24 fps, using commodity encoder hardware and software that nominally supports 4K content at 60 fps.