Stereo Camera Calibration via User-Aligned Temporary Images

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional methods for correcting display errors in stereo imaging due to misalignment of optical positions in stereo cameras require adjustment patterns, making it difficult for users to adjust the display positions of stereo images, especially after external shocks or aging, which can change the camera's optical position.

Innovation Solution

A computer-readable storage medium with an information processing program that allows users to easily adjust the display positions of stereo images by taking temporary images, calculating correction values based on user-input movements, and storing these values for correcting the display positions of stereo images, enabling stereoscopic visibility without the need for adjustment patterns.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If adjustment patterns are used for correcting display errors in stereo imaging, then the correction accuracy is improved, but the ease of operation deteriorates because users cannot easily perform the adjustment

Engineering Contradiction:
Improvecorrection accuracyVSAvoidease of adjustment
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The patent uses a photograph of the actual imaging target captured by the stereo camera as an adjustment image, rather than requiring a separate adjustment pattern. This copying approach allows users to adjust display positions using familiar visual content from their own imaging tasks, eliminating the need to prepare or locate specific adjustment patterns while maintaining correction accuracy through direct visual comparison of the captured images from both cameras

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The system allows users to perform self-adjustment of display positions using the adjustment images generated from their own captured photographs. Users can independently move and align the adjustment images on the display screen without requiring manufacturer intervention or specialized calibration equipment, enabling them to correct display errors themselves based on visual feedback from the captured images

Inventive Principle:
Principle #25Self-service

2Manufacturing precision

If adjustment patterns are required for correction, then the manufacturing precision can be maintained, but the device complexity increases due to the need for separate adjustment materials

Engineering Contradiction:
Improveoptical alignment precisionVSAvoidsystem complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The captured photograph serves multiple functions: it is both the imaging result and the adjustment image. The same image data captured by the stereo camera is used for both preserving the imaging content and for aligning the display positions of both cameras. This eliminates the need for separate adjustment patterns or calibration materials, reducing system complexity while maintaining the ability to achieve precise optical alignment correction

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent merges the adjustment image preparation step with the normal imaging process. Instead of requiring a separate adjustment pattern and a separate adjustment process, the system combines both functions by using the captured image itself as the adjustment reference. This integration eliminates additional components and steps, reducing device complexity while preserving manufacturing precision through the alignment process

Inventive Principle:
Principle #5Merging (Combining)

3Reliability

If the optical position of the stereo camera changes due to external shock or aging, then the reliability of the imaging system deteriorates, but the ease of repair can be improved if user-adjustable correction is provided

Engineering Contradiction:
Improveoptical position stabilityVSAvoidease of recalibration
Core Design Contradiction:
ReliabilityVSEase of repair

Solution Approach 1:

The system enables users to perform self-recalibration when optical position changes occur due to external shock or aging. Users can capture new adjustment images, move them on the display screen to align the images from both cameras, and have the correction values automatically calculated and stored. This self-service recalibration capability eliminates the need for professional service intervention, making the system easy to repair and maintain while compensating for reliability degradation from position drift

Inventive Principle:
Principle #25Self-service

4Manufacturing precision

If conventional correction methods are used, then the manufacturing precision can be ensured, but the productivity decreases because users cannot easily perform adjustment

Engineering Contradiction:
Improvedisplay position accuracyVSAvoidadjustment efficiency
Core Design Contradiction:
Manufacturing precisionVSProductivity

Solution Approach 1:

The system uses copies of the actual captured images as adjustment images, allowing users to immediately perform adjustments without seeking external adjustment patterns. Users can capture images and begin the adjustment process right away using the captured content itself, eliminating time spent searching for or preparing adjustment materials while maintaining display position accuracy through the alignment of the captured image pairs

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The adjustment process can be performed continuously and independently by users at any time without requiring manufacturer involvement. Users can capture images, adjust display positions, and store correction values in a continuous workflow. The system maintains the ability to achieve precise manufacturing-level correction while enabling continuous user-driven adjustment operations, significantly improving productivity compared to batch manufacturing-only correction methods

Inventive Principle:
Principle #20Continuity of useful action

Data Source

PatentUS9167231B2System and method for calibrating a stereoscopic camera based on manual alignment of test images
Publication Date: 2015.10.20 NINTENDO CO LTD
  • US9167231B2 patent drawing
  • US9167231B2 patent drawing
  • US9167231B2 patent drawing

AI summary

A first temporary taken image taken by a first imaging section of a stereo imaging section, and a second temporary taken image taken by a second imaging section of the stereo imaging section are displayed on a display section. A user aligns the display position of the first temporary taken image with the display position of the second temporary taken image, by moving the first temporary taken image displayed on the display section. Based on the result of the movement, the display positions of two images composing a stereo image taken with the stereo camera are corrected, and the stereo image is displayed on the display section in a stereoscopically visible manner.