Reversed Image Feature Detection in AR Displays

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing image processing techniques face difficulties in accurately detecting features in captured images that are reversed, particularly when the image capturing direction is the same as the display direction, leading to a confusing user experience in augmented reality applications.

Innovation Solution

A computer-readable recording medium with a program that includes a captured image acquiring unit, a display controlling unit, and a feature detecting unit, which performs reverse comparison processes to detect features in reversed images, and generates composite images by superimposing virtual objects onto real-space images, ensuring alignment and reducing user disorientation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If the captured image is reversed to match the display direction, then the user experience is improved, but the feature detection accuracy deteriorates

Engineering Contradiction:

Improveuser experienceVSAvoidfeature detection accuracy

Core Design Contradiction:

Ease of operationVSMeasurement precision

Solution Approach 1:

The patent applies inversion by creating a reversed image for detection purposes when the captured image is reversed for display. The feature detecting unit generates a reversed image from the captured image and uses this reversed image for feature detection, allowing accurate detection of features like two-dimensional bar codes while maintaining the reversed display orientation for better user experience.

Inventive Principle:

Principle #13The other way round (Inversion)

2Shape

If the captured image is reversed for display, then the display direction matches the image capturing direction, but the comparison with detection images becomes difficult

Engineering Contradiction:

Improvedisplay direction alignmentVSAvoidfeature detection difficulty

Core Design Contradiction:

ShapeVSDifficulty of detecting and measuring

Solution Approach 1:

The patent resolves this by inverting the detection image when the captured image is reversed. The feature detecting unit reverses the detection image before comparison, enabling accurate feature detection while maintaining the reversed display orientation. This allows the system to handle cases where the imaging device is positioned on the display surface side.

Inventive Principle:

Principle #13The other way round (Inversion)

3Shape

If the imaging device is positioned on the display surface side, then the captured image direction matches the display direction, but the feature detection becomes inaccurate

Engineering Contradiction:

Improveimage direction consistencyVSAvoidfeature detection precision

Core Design Contradiction:

ShapeVSMeasurement precision

Solution Approach 1:

The patent applies inversion by reversing the detection image when the captured image is reversed due to the imaging device position. The feature detecting unit generates a reversed image from the captured image and uses this for accurate feature detection, enabling precise detection even when the imaging device is positioned on the display surface side.

Inventive Principle:

Principle #13The other way round (Inversion)

Data Source

PatentUS9158984B2Computer-readable recording medium recording program for image processing, information processing apparatus, information processing system, and image processing method

Publication Date: 2015.10.13 NINTENDO CO LTD

AI summary

A computer is caused to execute: acquisition of a captured image captured by an imaging device; display of an image including the captured image on a display device; and detection from the captured image, of a feature in a real space captured in the captured image, using an image for detection of the feature. In a case where the captured image acquired in the acquisition of the image captured is a reversed image, the feature is detected by performing a reverse comparison process involving: comparing the captured image with a reversed image of the image for detection; or comparing an image obtained by further reversing the captured image, with the image for detection.