Stereo Virtual Camera Positioning via Marker-Based Dual-View Integration

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing stereoscopic display systems face inaccuracies in calculating the relative positions and orientations of cameras with respect to markers, leading to inconsistent virtual object images for the right and left eyes, which affects the stereoscopic view of virtual objects.

Innovation Solution

The system integrates position and orientation information from both camera imaging sections to determine the positions and orientations of virtual cameras, ensuring consistency and accuracy in generating stereoscopic images by averaging or calculating a midpoint, and adjusting the virtual camera positions and orientations to match the real camera configurations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If the relative positions and orientations of cameras with respect to markers are calculated based on images shot by each camera independently, then the calculation process is simple and fast, but the accuracy and consistency of the calculated positions and orientations deteriorate due to image blur and marker recognition errors

Engineering Contradiction:
Improveaccuracy of relative position and orientation calculationVSAvoidcomplexity of position orientation integration process
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent merges the position and orientation information calculated from both the right-eye and left-eye camera images into a single integrated set of information. This is achieved by calculating the relative positions and orientations from both cameras independently, then integrating these results to obtain unified position and orientation data that is more accurate and consistent than either individual calculation alone.

Inventive Principle:
Principle #5Merging (Combining)

2Reliability

If the position and orientation information from both cameras is integrated to determine virtual camera positions, then the consistency and accuracy of stereoscopic images improve, but the processing time and computational complexity increase

Engineering Contradiction:
Improveconsistency of stereoscopic imagesVSAvoidprocessing time for position orientation integration
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent performs preliminary calculations of relative positions and orientations from both cameras before the actual image generation process. By pre-computing and integrating the position and orientation information, the system prepares accurate virtual camera parameters in advance, which then can be used efficiently during the stereoscopic image generation without repeated complex calculations.

Inventive Principle:
Principle #10Preliminary action

3Measurement precision

If accurate position and orientation information is used to generate virtual images for both eyes, then the stereoscopic view quality improves, but the computational load and processing complexity increase

Engineering Contradiction:
Improveaccuracy of virtual object positioningVSAvoidcomplexity of virtual camera setting and image generation
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent creates virtual camera models that replicate the physical camera configurations. By setting up virtual cameras with positions and orientations derived from the integrated position orientation information, the system can generate stereoscopic images through virtual camera rendering without requiring complex real-time transformations, simplifying the overall image generation process while maintaining accuracy.

Inventive Principle:
Principle #26Copying

Data Source

PatentUS10015473B2Computer-readable storage medium, image display apparatus, image display system, and image display method
Publication Date: 2018.07.03 NINTENDO CO LTD
  • US10015473B2 patent drawing
  • US10015473B2 patent drawing
  • US10015473B2 patent drawing

AI summary

First, the interval between a left virtual camera and a right virtual camera is determined based on the relative position and the relative orientation of an outer imaging section (left) with respect to a marker, which are calculated from a result of marker recognition in the left real world image, and on the relative position and the relative orientation of an outer imaging section (right) with respect to the marker, which are calculated from a result of marker recognition in the right real world image. After the interval between the left virtual camera and the right virtual camera is determined, the positions and the orientations of the left virtual camera and the right virtual camera are determined based on the determined interval such that the relationship between the position and the orientation of the left virtual camera, and the position and the orientation of the right virtual camera is ideal.