AR Virtual Object Sizing via 3D Parallax Recognition

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing augmented reality technologies struggle to accurately control virtual objects in real spaces, as the size of real objects in images changes with distance, making it difficult to account for the actual size of objects in the real space.

Innovation Solution

An information processing apparatus and method that includes an image acquisition part and a display controller, which acquires images and controls virtual objects based on the recognized size of real objects in the real space, using sensors to determine the size and position of objects in three-dimensional space.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If virtual object control is based on the size of real object in image, then the control process is simple, but the accuracy of real space size representation deteriorates

Engineering Contradiction:
Improvecontrol process simplicityVSAvoidreal space size accuracy
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The patent transitions from two-dimensional image plane measurements to three-dimensional real space measurements by introducing depth information through parallax calculations. The system computes the actual size of real objects in 3D space rather than relying solely on their 2D projection sizes in the image, thereby resolving the contradiction between operational simplicity and measurement accuracy.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent introduces an intermediary calculation process that uses parallax information as a mediator between the image size and real space size. By calculating the relationship between parallax amounts from multiple viewpoints and the actual dimensions of real objects, the system accurately determines real space measurements while maintaining a systematic control process.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If multiple images from different viewpoints are used to recognize three-dimensional structure, then the measurement accuracy improves, but the device complexity increases

Engineering Contradiction:
Improvethree-dimensional structure recognition accuracyVSAvoidimaging system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent makes the imaging apparatus universal by enabling it to perform multiple functions: capturing images for both standard processing and augmented reality applications. The system can operate with a single imaging device that captures images from different positions, eliminating the need for separate specialized equipment while achieving three-dimensional structure recognition through parallax calculations.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system uses the imaging apparatus itself to generate the necessary multiple viewpoint images by moving the device to different positions. Rather than requiring additional dedicated sensors or cameras, the same imaging device serves multiple purposes by capturing images at different locations, thereby reducing overall system complexity while maintaining measurement accuracy.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS11188187B2Information processing apparatus, information processing method, and recording medium
Publication Date: 2021.11.30 SONY GROUP CORP
  • US11188187B2 patent drawing
  • US11188187B2 patent drawing
  • US11188187B2 patent drawing

AI summary

There is provided an information processing apparatus including an image acquisition part that acquires an image captured by an imaging part, and a display controller that causes a virtual object to be displayed in accordance with a recognition result of a real object shown in the image. The display controller controls the virtual object on a basis of a size of the real object in a real space.