AR Display Overlaying Virtual Images on Real Space

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current information processing systems fail to effectively overlay virtual-space images with real spaces, limiting the ability to provide relevant information to users in a seamless and interactive manner, particularly in environments like meetings or lectures where real-time input and guidance are necessary.

Innovation Solution

An information processing apparatus comprising a detector and a command unit that uses a light-transmissive head-mounted display device and a portable information terminal to detect user movement and overlay virtual-space images with real spaces, providing relevant information such as guided text input and support data near input targets like whiteboards.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If virtual-space images are overlaid with real space using a display device, then information can be provided to users in a seamless manner, but the system complexity increases due to the need for movement detection and image alignment

Engineering Contradiction:
Improveseamless information provisionVSAvoidsystem complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent merges the display device with photographing functionality, combining multiple functions (displaying virtual images and capturing real space) into a single integrated device. This reduces the number of separate components needed and simplifies the overall system architecture while maintaining the augmented reality experience.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The display device performs self-calibration and automatic alignment of virtual images with real space by utilizing its own photographing function to detect user movement and adjust the overlay accordingly. This eliminates the need for external calibration equipment or manual adjustment mechanisms.

Inventive Principle:
Principle #25Self-service

2Ease of operation

If relevant information is displayed near input targets based on user movement detection, then input guidance is improved, but the measurement precision requirements increase for accurate position tracking

Engineering Contradiction:
Improveinput guidanceVSAvoidposition tracking accuracy
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The system continuously detects user movement through the photographing function and uses this feedback to dynamically adjust the position of displayed information in real-time. This closed-loop feedback mechanism ensures that information remains accurately positioned near input targets even as the user moves, maintaining guidance accuracy without requiring ultra-precise measurement systems.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent transitions from tracking only two-dimensional screen coordinates to three-dimensional spatial positioning by incorporating user movement detection in physical space. This allows the system to map virtual information positions to real-world locations, providing more intuitive and accurate guidance for physical input actions.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Adaptability or versatility

If the display device has both display and photographing functions, then integration is improved, but the device complexity increases

Engineering Contradiction:
Improvefunction integrationVSAvoiddevice complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The display device is designed with multi-functionality, serving both as a display device for showing virtual-space images and as a photographing device for capturing real space and detecting user movement. This universal design allows a single device to perform multiple functions that would traditionally require separate components, thereby reducing overall system complexity despite the increased versatility of the individual device.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS11397320B2Information processing apparatus, information processing system, and non-transitory computer readable medium
Publication Date: 2022.07.26 FUJIFILM BUSINESS INNOVATION CORP
  • US11397320B2 patent drawing
  • US11397320B2 patent drawing
  • US11397320B2 patent drawing

AI summary

An information processing apparatus includes a detector and a command unit. The detector detects movement of a user using a display device based on an image photographed by the display device that displays a virtual-space image in such a manner as to be overlapped with a real space and that has a photographing function. The command unit commands the display device to display, as the virtual-space image, relevant information related to input information input to an input target at a position near the input target based on the detected movement of the user.