AR Virtual Information Scale Adjustment via Reference Object

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing Augmented Reality technologies fail to accurately overlay virtual information on real-world images due to unknown scales of the captured 3D space, resulting in inappropriate dimensions.

Innovation Solution

An information processing apparatus that includes an image acquisition unit, a space analysis unit, a scale reference detection unit, and a scale determination unit to analyze the 3D space structure, detect a scale reference object, and determine the scale of the 3D space, allowing for the adjustment and appropriate overlay of virtual information on real-world images.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If virtual information is overlayed on real-world images without scale analysis, then the overlay process is simple and fast, but the size of virtual information cannot be appropriately adjusted to match the 3D space scale

Engineering Contradiction:
Improvesize accuracy of virtual informationVSAvoidcomplexity of scale analysis system
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent introduces a scale reference object as an intermediary element to bridge the gap between 2D image and 3D space. By detecting the scale reference object's dimensions in the image and comparing them with known real-world dimensions, the system calculates the scale factor that mediates between the captured image scale and the actual 3D space scale, enabling accurate virtual information sizing without requiring complex full-space measurement systems.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system changes the parameter of virtual information size based on the calculated scale factor. By adjusting the size parameter of virtual information according to the scale relationship between the scale reference object in the image and its real-world dimensions, the system achieves appropriate size adjustment while maintaining computational efficiency through parameter transformation rather than complex geometric analysis.

Inventive Principle:
Principle #35Parameter changes

2Measurement precision

If the scale of 3D space is not determined, then the image processing is fast and simple, but virtual information cannot be displayed at appropriate dimensions in the 3D space

Engineering Contradiction:
Improvescale measurement of 3D spaceVSAvoidimage processing speed
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The patent extracts the scale determination function from the overall image processing pipeline by using a separate scale reference object. Instead of analyzing the entire 3D space structure to determine scale, the system isolates the scale measurement task to a specific reference object with known dimensions, allowing fast processing while achieving accurate scale measurement through targeted analysis of this extracted reference element.

Inventive Principle:
Principle #2Taking out (Extraction)

3Adaptability or versatility

If virtual information size is not adjusted according to 3D space scale, then the display process is simple, but the virtual information appears at incorrect sizes regardless of the actual 3D space dimensions

Engineering Contradiction:
Improveadaptability of virtual information size to 3D spaceVSAvoidcomplexity of scale-based adjustment system
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The scale reference object serves multiple functions: it acts as a size reference for calculating scale factors, provides a known dimension for computation, and enables the system to adapt virtual information size across different 3D space scales. This multi-functional reference object achieves universal adaptability without requiring complex analysis of each individual object's dimensions in the scene.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS8891855B2Information processing apparatus, information processing method, and program for generating an image including virtual information whose size has been adjusted
Publication Date: 2014.11.18 SONY GROUP CORP
  • US8891855B2 patent drawing
  • US8891855B2 patent drawing
  • US8891855B2 patent drawing

AI summary

An information processing apparatus includes an image acquisition unit for acquiring a real-world image, a space analysis unit for analyzing a three-dimensional space structure of the real-world image, a scale reference detection unit for detecting a length, in a three-dimensional space, of an object to be a scale reference that is included in the real-world image, and a scale determination unit for determining, from the length of the object detected by the scale reference detection unit, a scale of the three-dimensional space.