Panoramic Image Transform Apparatus for Camera Shake Compensation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing 360-degree panoramic imaging systems face challenges in minimizing camera shake and image distortion due to rotation and translation movements during exposure, which affect the quality of panoramic images.

Innovation Solution

A transform apparatus and method that utilize a geometry information detector, parameter setup unit, and geometry processing circuit to perform geometry transform operations on vertex lists, accounting for rotation and translation of the image capture module, thereby generating a modified vertex list that defines a vertex mapping between camera images and panoramic images, ensuring optimal image quality.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If geometry transform operations are performed to compensate for camera movement, then image stabilization quality is improved, but device complexity increases

Engineering Contradiction:
Improveimage stabilization qualityVSAvoiddevice complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The geometry processing circuit divides the vertex list into multiple groups and processes them in parallel using multiple transformation units. Each unit handles specific vertex groups independently, allowing simultaneous computation of transformation coordinates for different image regions. This segmentation enables complex geometry transformations to be performed efficiently without requiring a single monolithic processing unit.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system pre-calculates transformation parameters including rotation matrices and translation vectors based on detected camera movement. These parameters are stored and ready before actual image rendering occurs. By preparing transformation data in advance, the system reduces real-time computational burden during image generation while maintaining high stabilization quality.

Inventive Principle:
Principle #10Preliminary action

2Manufacturing precision

If real-time geometry transformation is performed for all vertices, then image quality is maintained, but processing time increases

Engineering Contradiction:
Improveimage qualityVSAvoidprocessing time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The system applies geometry transformation selectively to vertex groups that are affected by camera movement, rather than uniformly processing all vertices. The enable signal controls which transformation units are activated based on detected movement magnitude. This partial action approach maintains image quality for affected regions while reducing unnecessary processing time for stable regions.

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The processing system dynamically adjusts the number of active transformation units based on detected camera movement. When movement is detected, more units are activated to maintain image quality; when stable, fewer units process vertices, reducing processing time. This dynamic adaptation balances image quality and processing speed based on actual conditions.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS10186067B2Method and apparatus for generating panoramic image with rotation, translation and warping process
Publication Date: 2019.01.22 CUPOLA360 INC
  • US10186067B2 patent drawing
  • US10186067B2 patent drawing
  • US10186067B2 patent drawing

AI summary

A transform apparatus applied in an image processing system with an image capture module is disclosed. The transform apparatus comprises a geometry information detector, a parameter setup unit, a primitive assembly unit and a geometry processing circuit. The geometry information detector measures geometry information of the image capture module. The parameter setup unit calculates geometry parameters and determines whether to assert an enable signal according to the geometry information. The primitive assembly unit receives an original vertex list and the enable signal to generate a vertex/ID flow. The geometry processing circuit receives the geometry parameters and performs geometry transform operations over the vertex/ID flow in response to whether the first enable signal is asserted to generate a modified vertex list. The geometry information comprises at least one of a displacement and rotation angles of the image capture module.