AR Object Variety via Primary-Secondary Recognition Targets

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing augmented reality (AR) applications face limitations in increasing the variety of displayable AR objects due to high processing costs associated with recognizing multiple real objects, which restricts the enhancement of AR object diversity.

Innovation Solution

An image processing apparatus and method that acquires images of real objects with primary and secondary recognition targets, using image recognition to set an augmented reality space and decide AR objects based on the secondary recognition target, thereby reducing processing costs and enhancing AR object variety.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If many kinds of real objects are recognized to enhance variety of AR objects, then the variety of displayable AR objects increases, but the processing cost increases significantly

Engineering Contradiction:

Improvevariety of displayable AR objectsVSAvoidprocessing cost

Core Design Contradiction:

Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The recognition target is divided into a primary recognition target (first pattern) and a secondary recognition target (second pattern). The primary target is used for basic AR space setting, while the secondary target provides additional information for selecting specific AR objects. This segmentation allows the system to recognize multiple object types without increasing overall processing complexity, as each segment handles a specific aspect of recognition.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The secondary recognition target acts as an intermediary that bridges the primary recognition target and the final AR object selection. Instead of directly recognizing multiple real objects through complex processing, the system uses the secondary pattern as an intermediate indicator that efficiently guides AR object selection based on the already-established primary recognition.

Inventive Principle:

Principle #24Intermediary (Mediator)

2Adaptability or versatility

If feature data for multiple real objects is stored for matching, then the variety of AR objects increases, but the processing time and computational resources increase

Engineering Contradiction:

Improvevariety of AR objectsVSAvoidprocessing time

Core Design Contradiction:

Adaptability or versatilityVSLoss of time

Solution Approach 1:

The secondary recognition target is designed and positioned in advance on the print medium, with its pattern预先 defined to correspond to specific AR objects. This preliminary arrangement eliminates the need for real-time feature extraction and matching during AR processing, as the secondary pattern directly indicates which AR object should be displayed based on its pre-defined correspondence.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

Instead of storing and processing extensive feature data for multiple real objects, the system uses a simplified secondary pattern copy that serves as a direct indicator for AR object selection. This pattern copy contains encoded information about the intended AR object without requiring complex feature matching, significantly reducing processing time while maintaining variety.

Inventive Principle:

Principle #26Copying

3Adaptability or versatility

If multiple recognition targets are used to increase AR object variety, then the displayable AR object diversity improves, but the device complexity and processing overhead increase

Engineering Contradiction:

ImproveAR object diversityVSAvoidprocessing overhead

Core Design Contradiction:

Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The primary and secondary recognition targets are merged into a single integrated design on the print medium. The secondary pattern is positioned in a predetermined relationship with the primary pattern, allowing both recognition functions to be achieved through a unified structure rather than separate, independent recognition systems. This merging reduces processing overhead by handling both recognition tasks within a single processing framework.

Inventive Principle:

Principle #5Merging (Combining)

Solution Approach 2:

The secondary recognition target serves multiple functions: it acts as a visual element of the print medium, provides additional recognition information, and encodes selection data for AR objects. This multi-functionality allows the system to achieve diverse AR object display capabilities without proportionally increasing processing overhead, as the same secondary pattern structure performs multiple roles simultaneously.

Inventive Principle:

Principle #6Universality (Multi-functionality)

Data Source

PatentUS10186084B2Image processing to enhance variety of displayable augmented reality objects

Publication Date: 2019.01.22 SONY GROUP CORP

AI summary

There is provided an image processing apparatus including an image acquisition unit configured to acquire an image that shows a real object including a primary recognition target and a secondary recognition target, and a control unit configured to set an augmented reality space associated with the image on the basis of image recognition of the primary recognition target, and configured to decide an augmented reality object to be arranged in the augmented reality space depending on the secondary recognition target that is recognized on the basis of the image recognition of the primary recognition target.