Dual Camera Parallax Correction via Posture-Aware Synthesis

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Panoramic image pickup using double-sided cameras often results in unintended camera operator reflection or parallax due to displacement between front and rear cameras, leading to suboptimal image synthesis.

Innovation Solution

An image generation apparatus and method that includes a component image generation unit to associate posture information with images from cameras having different optical axes, a synthesis image generation unit to combine these images, and an image pickup mode changer to switch between compound eye and single eye synthesis modes, allowing for seamless image stitching and correction of parallax.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If panoramic image pickup is carried out using double-sided cameras, then the camera operator can be captured in the front side camera, but unintended reflection or parallax appears due to displacement between front and rear cameras

Engineering Contradiction:
Improveimage pickup capabilityVSAvoidimage synthesis quality
Core Design Contradiction:
Adaptability or versatilityVSManufacturing precision

Solution Approach 1:

The patent introduces an image synthesis unit as an intermediary that processes images from both front and rear cameras. This unit applies synthesis processing to combine the images while correcting for the displacement between cameras, thereby eliminating parallax and unwanted reflections while preserving the ability to capture the camera operator.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Area of stationary object

If images are picked up using cameras with different optical axes, then more comprehensive coverage is achieved, but parallax and misalignment occur in the synthesized image

Engineering Contradiction:
Improveimage coverage areaVSAvoidimage alignment accuracy
Core Design Contradiction:
Area of stationary objectVSMeasurement precision

Solution Approach 1:

The patent employs feedback mechanisms where the system detects the optical axis differences between cameras and uses this information to adjust the synthesis processing. By feeding back the alignment information into the synthesis unit, the system can compensate for parallax and maintain high alignment accuracy while preserving wide coverage.

Inventive Principle:
Principle #23Feedback

3Area of stationary object

If compound eye synthesis mode is used to connect images from multiple cameras, then comprehensive panoramic coverage is achieved, but complexity in image processing increases

Engineering Contradiction:
Improvepanoramic coverageVSAvoidimage processing complexity
Core Design Contradiction:
Area of stationary objectVSDevice complexity

Solution Approach 1:

The patent divides the image synthesis process into distinct segments: the front camera captures the operator, the rear camera captures the scene, and the synthesis unit combines them. By segmenting the processing into modular steps (capture, align, combine), the system achieves comprehensive panoramic coverage while managing processing complexity through structured organization.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS9560274B2Image generation apparatus and image generation method
Publication Date: 2017.01.31 SONY INTERACTIVE ENTERTAINMENT LLC
  • US9560274B2 patent drawing
  • US9560274B2 patent drawing
  • US9560274B2 patent drawing

AI summary

Methods and apparatus provide for generating a component image in which, with images picked up using a front side camera and a rear side camera built in portable equipment, posture information of the portable equipment is associated; combining a plurality of component images between which the posture of the portable equipment is different to generate a synthesis image; changing over an image pickup mode between a double-sided synthesis image pickup mode in which a synthesis image of one half circumference picked up by the front side camera and a synthesis image of one half circumference picked up by the rear side camera are connected to each other to pick up a synthesis image of a whole circumference and a single-sided synthesis image pickup mode in which a synthesis image of a whole circumference is picked up by each of the front side camera and the rear side camera.