Omni-directional Image Processing Selective Channel Transmission
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Omni-directional image processing systems face challenges in minimizing bandwidth consumption and reducing distortion while maintaining Quality of Service (QoS) during the transmission and reception of omni-directional images, particularly due to the large capacity and three-dimensional nature of these images.
Innovation Solution
An image processing apparatus and method that includes a storage unit for storing input frames with preset arrangement attributes, a transceiver for transmitting metadata and image data through multiple channels matching the image areas, and a processor for controlling the transmission and mapping of image data based on viewing angle information to reduce bandwidth usage and distortion.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of energy
If omni-directional image is mapped to two-dimensional plane image for compression, then data transmission bandwidth is reduced, but image distortion increases
Solution Approach 1:
The patent divides the omni-directional image into multiple image areas (e.g., first image area, second image area, third image area) with different arrangement attributes. Each image area is independently arranged and transmitted through separate transmission channels, allowing selective transmission based on viewing angle information without requiring complete 2D plane mapping, thus reducing distortion while optimizing bandwidth usage.
2Reliability
If complete omni-directional image is transmitted, then image quality is maintained, but system bandwidth resources are overloaded
Solution Approach 1:
The patent transmits only the necessary image areas based on viewing angle information rather than the complete omni-directional image. The transmitter determines which image areas (first, second, third image areas) correspond to the viewer's current viewing angle and transmits only those portions, reducing bandwidth consumption while maintaining perceived image quality.
Solution Approach 2:
The patent pre-arranges the omni-directional image into multiple image areas with specific arrangement attributes before transmission. This preliminary segmentation and organization allows the receiver to quickly identify and render only the relevant image areas based on viewing angle information, avoiding the need to process and transmit the entire image dataset.
3Quantity of substance
If three-dimensional spatial image is mapped to two-dimensional plane image, then data capacity is reduced, but distortion is generated
Solution Approach 1:
The patent maintains a hybrid representation where image areas retain their three-dimensional spatial arrangement attributes while being transmitted in a format suitable for two-dimensional display. By preserving the arrangement attributes (such as spherical coordinate information) and only performing selective 2D mapping of relevant areas based on viewing angle, the system reduces data capacity requirements without completely flattening the 3D spatial relationships, thus minimizing distortion.
Data Source
AI summary
An image processing apparatus is disclosed. The image processing apparatus includes a storage unit; a transceiver; and a processor for controlling the storage unit to store an input frame including a plurality of image areas having preset arrangement attributes and metadata including the preset arrangement attributes, control the transceiver to receive viewing angle information, and control the transceiver to transmit the metadata and image data of at least one image region corresponding to the viewing angle information among the plurality of image regions by using at least one of the plurality of transmission channels matched with the plurality of image regions.