Direct Camera Image to Equirectangular Projection Mapping

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing image processing methods require significant memory bandwidth and storage for intermediate cube-map representations when stitching together multiple camera images to form a wide-angle or 360° image, as they need to be converted and stored before being transformed into a final output projection format.

Innovation Solution

An apparatus and method that converts multiple camera images directly into a selectable output projection format, such as equirectangular, cylindrical, or rectilinear, using an intermediate cube-map representation, allowing for on-the-fly stitching and output without the need for intermediate storage, thereby reducing memory requirements and processing complexity.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If intermediate cube-map representations are stored before transformation into final output projection format, then image stitching can be performed with flexible projection formats, but memory bandwidth usage and storage requirements increase significantly

Engineering Contradiction:

Improveprojection format flexibilityVSAvoidmemory bandwidth usage

Core Design Contradiction:

Adaptability or versatilityVSQuantity of substance

Solution Approach 1:

The patent applies preliminary action by pre-calculating and storing lookup tables that map camera image locations to equirectangular projection locations. This allows the system to directly transform camera images into the final equirectangular output format without requiring intermediate cube-map storage, thereby reducing memory bandwidth usage while maintaining projection format flexibility

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The patent extracts the essential transformation relationship between camera images and equirectangular projection by creating lookup tables that contain only the necessary mapping information. This eliminates the need to store complete intermediate cube-map representations, reducing memory requirements while preserving the ability to perform image stitching in the desired output format

Inventive Principle:

Principle #2Taking out (Extraction)

2Adaptability or versatility

If intermediate cube-map representations are stored before transformation, then image stitching can be performed with flexible projection formats, but storage requirements increase

Engineering Contradiction:

Improveprojection format flexibilityVSAvoidstorage requirements

Core Design Contradiction:

Adaptability or versatilityVSVolume of stationary object

Solution Approach 1:

The patent extracts only the essential transformation data needed for image stitching by creating lookup tables that store mapping relationships between camera image coordinates and equirectangular projection coordinates. This eliminates the need to store complete intermediate cube-map representations, significantly reducing storage requirements while maintaining the ability to generate images in various projection formats

Inventive Principle:

Principle #2Taking out (Extraction)

Solution Approach 2:

The patent applies preliminary action by pre-computing and storing compact lookup tables that contain transformation mappings. This preliminary preparation allows the system to directly transform camera images into the final equirectangular format without requiring large intermediate storage, thereby reducing storage requirements while preserving projection format adaptability

Inventive Principle:

Principle #10Preliminary action

3Adaptability or versatility

If multiple conversion steps are performed (camera images to cube-map to final output), then complex projection transformations can be achieved, but processing complexity increases

Engineering Contradiction:

Improveprojection transformation capabilityVSAvoidprocessing complexity

Core Design Contradiction:

Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent merges the transformation process by directly mapping camera images to the final equirectangular projection format using pre-computed lookup tables. This combines what would otherwise be separate transformation steps into a single direct operation, reducing processing complexity while maintaining the capability to perform complex projection transformations

Inventive Principle:

Principle #5Merging (Combining)

Solution Approach 2:

The patent applies preliminary action by pre-calculating and storing lookup tables that contain the complete transformation mappings from camera images to equirectangular projection. This preliminary preparation eliminates the need for multiple sequential conversion steps during actual image processing, thereby reducing processing complexity while preserving comprehensive projection transformation capability

Inventive Principle:

Principle #10Preliminary action

Data Source

PatentUS11528412B2Apparatus and method for stitching together multiple images

Publication Date: 2022.12.13 AVAGO TECHNOLOGIES INTERNATIONAL SALES PTE LTD

AI summary

An apparatus for stitching together multiple camera images to form a blended image having an output projection format. The apparatus is configured to convert each of the multiple camera images into the output projection format. It is configured to stitch together the converted images to form a single image. It is also configured to output the single image as the blended image having the output projection format.